AP Computer Science Principles Flashcards: Parallel And Distributed Computing

What this deck covers

This deck focuses on Parallel And Distributed Computing, giving you a quick way to review the definitions, rules, and examples that matter most for AP Computer Science Principles.

How to use these flashcards

Work through these flashcards in short sessions. Try to answer each prompt before flipping the card, then revisit any cards you miss until the explanation feels automatic.

Flashcard 1: What does scalability mean in parallel computing?

Answer: Ability to handle increasing workloads by adding resources. System grows efficiently as demand increases without performance loss.

Flashcard 2: What is load sharing in distributed systems?

Answer: Distributing tasks across multiple systems to balance workload. Prevents system overload by distributing work among available resources.

Flashcard 3: What is fault tolerance in distributed systems?

Answer: Ability to continue operation despite failures. System maintains functionality when individual components fail.

Flashcard 4: What is a grid computing system?

Answer: Network of computers working together to perform large tasks. Geographically distributed computers share computational workload efficiently.

Flashcard 5: What is the purpose of a hypervisor?

Answer: Software that creates and manages virtual machines. Enables multiple operating systems to run on single physical machine.

Flashcard 6: What is a multicore processor?

Answer: A single computing component with two or more independent cores. Multiple processing units on single chip enable parallel execution.

Flashcard 7: What is Amdahl's Law?

Answer: Defines speedup limits in parallel computing with fixed workload. Sequential portions limit maximum achievable speedup from parallelization.

Flashcard 8: What does 'heterogeneous computing' refer to?

Answer: Use of different types of processors for computing tasks. Combines CPUs, GPUs, and specialized processors for optimal performance.

Flashcard 9: What is data parallelism?

Answer: Same operation performed on different pieces of data. Multiple processors process different data sets using identical instructions.

Flashcard 10: What is a peer-to-peer network?

Answer: Network where each node can act as both client and server. Decentralized architecture eliminates need for central server coordination.

Flashcard 11: What is fault tolerance in distributed systems?

Answer: Ability to continue operation despite failures. System maintains functionality when individual components fail.

Flashcard 12: What is Moore's Law?

Answer: Observation that transistor counts double approximately every two years. Predicts exponential growth in computing power over time.

Flashcard 13: Identify the main benefit of parallel computing.

Answer: Increased computational speed. Multiple processors working together complete tasks faster than single processor.

Flashcard 14: What is Moore's Law?

Answer: Observation that transistor counts double approximately every two years. Predicts exponential growth in computing power over time.

Flashcard 15: What is a distributed database?

Answer: Database in which data is stored across multiple locations. Information spans multiple sites for redundancy and accessibility.

Flashcard 16: Define 'elasticity' in cloud computing.

Answer: Ability to scale resources up or down as needed. Resources automatically adjust to match current demand levels.

Flashcard 17: Identify the main challenge of distributed computing.

Answer: Coordination and communication between nodes. Managing communication delays and ensuring data consistency across nodes.

Flashcard 18: What is a deadlock in computing?

Answer: Situation where processes are unable to proceed due to resource contention. Circular dependency prevents any process from making progress.

Flashcard 19: What is load sharing in distributed systems?

Answer: Distributing tasks across multiple systems to balance workload. Prevents system overload by distributing work among available resources.

Flashcard 20: What is a deadlock in computing?

Answer: Situation where processes are unable to proceed due to resource contention. Circular dependency prevents any process from making progress.

Flashcard 21: What does scalability mean in parallel computing?

Answer: Ability to handle increasing workloads by adding resources. System grows efficiently as demand increases without performance loss.

Flashcard 22: What is the purpose of a hypervisor?

Answer: Software that creates and manages virtual machines. Enables multiple operating systems to run on single physical machine.

Flashcard 23: What is a cluster in computing?

Answer: A set of connected computers working as a single system. Multiple machines function together as unified computational resource.

Flashcard 24: What is virtualization in computing?

Answer: Creating virtual versions of components like servers or networks. Software layer abstracts physical hardware into logical resources.

Flashcard 25: What is data parallelism?

Answer: Same operation performed on different pieces of data. Multiple processors process different data sets using identical instructions.

Flashcard 26: What is the 'speedup' formula in parallel computing?

Answer: $S = \frac{T_s}{T_p}$, where $T_s$ is serial time, $T_p$ is parallel time. Measures performance improvement from using multiple processors.

Flashcard 27: What is the purpose of a task scheduler?

Answer: To allocate resources to tasks in a computing environment. Determines execution order and resource allocation for optimal performance.

Flashcard 28: What is a homogeneous computing environment?

Answer: Computing environment where all processors are of the same type. All processors share identical architecture and instruction sets.

Flashcard 29: What is a virtual machine?

Answer: Software-based emulation of a hardware computer. Isolated environment runs operating system independently on shared hardware.

Flashcard 30: What is a node in distributed computing?

Answer: A single device in a distributed system. Individual computer or device participating in the distributed network.

Flashcard 31: Identify one use case for distributed computing.

Answer: Cloud computing services. Remote servers provide scalable computing resources on demand.

Flashcard 32: What is a virtual machine?

Answer: Software-based emulation of a hardware computer. Isolated environment runs operating system independently on shared hardware.

Flashcard 33: What is load balancing in parallel computing?

Answer: Even distribution of work across processors to optimize performance. Prevents any single processor from being overwhelmed while others idle.

Flashcard 34: What is task parallelism?

Answer: Different tasks execute simultaneously across processors. Each processor handles distinct operations for maximum efficiency.

Flashcard 35: What is concurrency in computing?

Answer: Multiple computations are executed during overlapping time periods. Tasks progress simultaneously but may not execute at identical moments.

Flashcard 36: What is a homogeneous computing environment?

Answer: Computing environment where all processors are of the same type. All processors share identical architecture and instruction sets.

Flashcard 37: Identify one disadvantage of parallel computing.

Answer: Increased complexity in programming. Coordinating multiple processors requires sophisticated programming techniques.

Flashcard 38: Identify one use case for distributed computing.

Answer: Cloud computing services. Remote servers provide scalable computing resources on demand.

Flashcard 39: What is a distributed database?

Answer: Database in which data is stored across multiple locations. Information spans multiple sites for redundancy and accessibility.

Flashcard 40: What is task parallelism?

Answer: Different tasks execute simultaneously across processors. Each processor handles distinct operations for maximum efficiency.

Flashcard 41: What is message passing in distributed systems?

Answer: Communication method between processes via messages. Processes exchange information without sharing memory directly.

Flashcard 42: What is distributed computing?

Answer: Computing using multiple networked computers to complete tasks. Spreads computation across separate machines connected via network.

Flashcard 43: What is a supercomputer?

Answer: Extremely fast computer for complex calculations. Specialized machine designed for high-performance scientific computations.

Flashcard 44: What is cloud computing?

Answer: Delivery of computing services over the internet. On-demand access to shared computing resources via internet connectivity.

Flashcard 45: What is the 'speedup' formula in parallel computing?

Answer: $S = \frac{T_s}{T_p}$, where $T_s$ is serial time, $T_p$ is parallel time. Measures performance improvement from using multiple processors.

Flashcard 46: What is parallel computing?

Answer: Simultaneous use of multiple processors to solve problems faster. Divides tasks across multiple CPUs for faster execution.

Flashcard 47: What does 'heterogeneous computing' refer to?

Answer: Use of different types of processors for computing tasks. Combines CPUs, GPUs, and specialized processors for optimal performance.

Flashcard 48: What is message passing in distributed systems?

Answer: Communication method between processes via messages. Processes exchange information without sharing memory directly.

Flashcard 49: Define 'elasticity' in cloud computing.

Answer: Ability to scale resources up or down as needed. Resources automatically adjust to match current demand levels.

Flashcard 50: Identify one disadvantage of parallel computing.

Answer: Increased complexity in programming. Coordinating multiple processors requires sophisticated programming techniques.

Flashcard 51: What is cloud computing?

Answer: Delivery of computing services over the internet. On-demand access to shared computing resources via internet connectivity.

Flashcard 52: What is a peer-to-peer network?

Answer: Network where each node can act as both client and server. Decentralized architecture eliminates need for central server coordination.

Flashcard 53: What is a bottleneck in computing?

Answer: A point of congestion that limits performance. Slowest component determines overall system performance speed.

Flashcard 54: What does the term 'throughput' mean?

Answer: Amount of work performed by a system in a given time period. Measures data processed or tasks completed per unit time.

Flashcard 55: What is a bottleneck in computing?

Answer: A point of congestion that limits performance. Slowest component determines overall system performance speed.

Flashcard 56: What is parallel computing?

Answer: Simultaneous use of multiple processors to solve problems faster. Divides tasks across multiple CPUs for faster execution.

Flashcard 57: Identify the main challenge of distributed computing.

Answer: Coordination and communication between nodes. Managing communication delays and ensuring data consistency across nodes.

Flashcard 58: What is a multicore processor?

Answer: A single computing component with two or more independent cores. Multiple processing units on single chip enable parallel execution.

Flashcard 59: What is concurrency in computing?

Answer: Multiple computations are executed during overlapping time periods. Tasks progress simultaneously but may not execute at identical moments.

Flashcard 60: What does the term 'throughput' mean?

Answer: Amount of work performed by a system in a given time period. Measures data processed or tasks completed per unit time.

Flashcard 61: What role does middleware play in distributed systems?

Answer: Software layer that enables communication between components. Abstracts hardware differences to simplify distributed application development.

Flashcard 62: What is distributed computing?

Answer: Computing using multiple networked computers to complete tasks. Spreads computation across separate machines connected via network.

Flashcard 63: What is a race condition?

Answer: Flawed execution outcome due to unsynchronized data access. Multiple processes competing for resources produce unpredictable results.

Flashcard 64: What is a cluster in computing?

Answer: A set of connected computers working as a single system. Multiple machines function together as unified computational resource.

Flashcard 65: What is a race condition?

Answer: Flawed execution outcome due to unsynchronized data access. Multiple processes competing for resources produce unpredictable results.

Flashcard 66: What is a node in distributed computing?

Answer: A single device in a distributed system. Individual computer or device participating in the distributed network.

Flashcard 67: What is synchronization in computing?

Answer: Coordination of events to operate in unison. Ensures processes execute in correct order for consistent results.

Flashcard 68: What is a grid computing system?

Answer: Network of computers working together to perform large tasks. Geographically distributed computers share computational workload efficiently.

Flashcard 69: What is synchronization in computing?

Answer: Coordination of events to operate in unison. Ensures processes execute in correct order for consistent results.

Flashcard 70: What does latency refer to in computing?

Answer: Time delay in data processing or communication. Measures time between request initiation and response completion.

Flashcard 71: What is the purpose of a task scheduler?

Answer: To allocate resources to tasks in a computing environment. Determines execution order and resource allocation for optimal performance.

Flashcard 72: What is load balancing in parallel computing?

Answer: Even distribution of work across processors to optimize performance. Prevents any single processor from being overwhelmed while others idle.

Flashcard 73: What is a supercomputer?

Answer: Extremely fast computer for complex calculations. Specialized machine designed for high-performance scientific computations.

Flashcard 74: What is virtualization in computing?

Answer: Creating virtual versions of components like servers or networks. Software layer abstracts physical hardware into logical resources.

Flashcard 75: Identify the main benefit of parallel computing.

Answer: Increased computational speed. Multiple processors working together complete tasks faster than single processor.

Flashcard 76: What role does middleware play in distributed systems?

Answer: Software layer that enables communication between components. Abstracts hardware differences to simplify distributed application development.

Flashcard 77: What is Amdahl's Law?

Answer: Defines speedup limits in parallel computing with fixed workload. Sequential portions limit maximum achievable speedup from parallelization.

Flashcard 78: What does latency refer to in computing?

Answer: Time delay in data processing or communication. Measures time between request initiation and response completion.