AI EducademyAIEducademy
๐ŸŒณ

AI Foundations

๐ŸŒฑ
AI Seeds

Start from zero

๐ŸŒฟ
AI Sprouts

Build foundations

๐ŸŒณ
AI Branches

Apply in practice

๐Ÿ•๏ธ
AI Canopy

Go deep

๐ŸŒฒ
AI Forest

Master AI

๐Ÿ”จ

AI Mastery

โœ๏ธ
AI Sketch

Start from zero

๐Ÿชจ
AI Chisel

Build foundations

โš’๏ธ
AI Craft

Apply in practice

๐Ÿ’Ž
AI Polish

Go deep

๐Ÿ†
AI Masterpiece

Master AI

๐Ÿš€

Career Ready

๐Ÿš€
Interview Launchpad

Start your journey

๐ŸŒŸ
Behavioral Mastery

Master soft skills

๐Ÿ’ป
Technical Interviews

Ace the coding round

๐Ÿค–
AI & ML Interviews

ML interview mastery

๐Ÿ†
Offer & Beyond

Land the best offer

View All Programsโ†’

Lab

7 experiments loaded
๐Ÿง Neural Network Playground๐Ÿค–AI or Human?๐Ÿ’ฌPrompt Lab๐ŸŽจImage Generator๐Ÿ˜ŠSentiment Analyzer๐Ÿ’กChatbot Builderโš–๏ธEthics Simulator
๐ŸŽฏMock InterviewEnter the Labโ†’
JourneyBlog
๐ŸŽฏ
About

Making AI education accessible to everyone, everywhere

โ“
FAQ

Common questions answered

โœ‰๏ธ
Contact

Get in touch with us

โญ
Open Source

Built in public on GitHub

Get Started
AI EducademyAIEducademy

MIT Licence. Open Source

Learn

  • Academics
  • Lessons
  • Lab

Community

  • GitHub
  • Contribute
  • Code of Conduct
  • About
  • FAQ

Support

  • Buy Me a Coffee โ˜•
  • Terms of Service
  • Privacy Policy
  • Contact
AI & Engineering Academicsโ€บโœ๏ธ AI Sketchโ€บLessonsโ€บGreedy Algorithms
๐Ÿƒ
AI Sketch โ€ข Intermediateโฑ๏ธ 17 min read

Greedy Algorithms

What Makes an Algorithm Greedy?

A greedy algorithm builds a solution one step at a time, always picking the option that looks best right now - without reconsidering past choices. No backtracking, no looking ahead.

It works when two properties hold:

  1. Greedy choice property - a locally optimal choice leads to a globally optimal solution.
  2. Optimal substructure - the remaining problem after each choice is a smaller instance of the same problem.

Activity Selection - The Classic Example

Given a set of activities with start and end times, select the maximum number of non-overlapping activities.

Greedy strategy: sort by end time, always pick the activity that finishes earliest.

def max_activities(intervals):
    intervals.sort(key=lambda x: x[1])
    count, end = 0, 0
    for s, e in intervals:
        if s >= end:
            count += 1
            end = e
    return count

Why does this work? Picking the earliest-finishing activity leaves the most room for future activities. No other choice can do better.

Timeline showing activity selection by earliest end time
Selecting by earliest end time maximises the number of non-overlapping activities.

Huffman Coding - Concept

Build an optimal prefix-free binary code by repeatedly merging the two lowest-frequency symbols. This is greedy: at each step, merge the cheapest pair. The result is a tree where frequent symbols get short codes.

๐Ÿคฏ
Huffman coding is used in JPEG, MP3, and ZIP compression. David Huffman invented it as a student in 1952 - it was a homework assignment!

Jump Game

Given an array where nums[i] is the maximum jump length from index i, determine if you can reach the last index.

Greedy approach: track the farthest index reachable so far. Scan left to right - if you ever fall behind, return false.

def can_jump(nums):
    farthest = 0
    for i, jump in enumerate(nums):
        if i > farthest:
            return False
        farthest = max(farthest, i + jump)
    return True
๐Ÿง Quick Check

In the Jump Game, what does the greedy variable 'farthest' represent?

Lesson 9 of 100% complete
โ†Recursion and Backtracking

Discussion

Sign in to join the discussion

Suggest an edit to this lesson

Gas Station

Travel a circular route with gas stations. At station i you gain gas[i] fuel and spend cost[i] to reach the next station. Find the starting station that lets you complete the circuit, or return โˆ’1.

Greedy insight: if total gas โ‰ฅ total cost, a solution exists. Track a running surplus; whenever it drops below zero, the answer must start after that point.

Task Scheduler

Schedule tasks with a cooldown of n between identical tasks. Greedy: always pick the most frequent remaining task. The answer depends on the maximum frequency and how many tasks share it.

Tasks: A A A B B C, cooldown = 2
Schedule: A B C A B _ A
Total = 7
๐Ÿค”
Think about it:In the task scheduler, why does picking the most frequent task first minimise idle slots? What would go wrong if you picked the least frequent first?

Fractional Knapsack vs 0/1 Knapsack

Fractional knapsack: you can take fractions of items. Greedy works - sort by value-per-weight, take the best ratio first.

0/1 knapsack: items are all-or-nothing. Greedy fails here because skipping a heavy-but-valuable item might be worse than taking two lighter ones. This requires dynamic programming.

Items: (weight=3, value=4), (weight=2, value=3), (weight=2, value=3)
Capacity: 4

Greedy (best ratio first): takes item 1 (w=3, v=4) โ†’ 1 remaining โ†’ can't fit rest โ†’ value = 4
Optimal: takes items 2+3 (w=4, v=6) โ†’ value = 6 โœ— Greedy fails!
๐Ÿง Quick Check

Why does the greedy approach fail for the 0/1 knapsack problem?

When Does Greedy Work?

โœ… Works when you can prove the greedy choice property:

  • Interval scheduling, Huffman coding, minimum spanning trees, Dijkstra's algorithm, coin change with standard denominations

โŒ Fails when local optima don't compose into global optima:

  • 0/1 knapsack, longest path in general graphs, travelling salesman

Proving Greedy Correctness - Exchange Argument

The standard technique: assume an optimal solution that doesn't use the greedy choice. Show you can exchange one of its choices for the greedy choice without making the solution worse. This proves greedy is at least as good.

๐Ÿง Quick Check

What is the 'exchange argument' used for?

Greedy vs Dynamic Programming

| Aspect | Greedy | Dynamic Programming | |--------|--------|---------------------| | Choices | One best choice per step | Explore all sub-problems | | Revisits past? | Never | Yes - stores sub-results | | Speed | Usually faster | Depends on state space | | Correctness | Only if provable | Always (if formulated right) |

When in doubt, start greedy - if you can't prove it works, switch to DP.

๐Ÿคฏ
Dijkstra's shortest-path algorithm is greedy - it always processes the closest unvisited node. It works because edge weights are non-negative, ensuring the greedy choice is safe.
๐Ÿค”
Think about it:You're given coin denominations [1, 3, 4] and need to make change for 6. The greedy approach picks 4+1+1=3 coins, but the optimal is 3+3=2 coins. What about these denominations breaks the greedy choice property?

๐Ÿ“š Further Reading

  • NeetCode - Greedy playlist - curated greedy problems with explanations
  • Tech Interview Handbook - Greedy - when to use greedy and common patterns
  • CP-Algorithms - Greedy algorithms - deeper theory and proofs