T
linux unix grep sed awk cli devops cheat-sheet

Unix Text Processing Master Guide: Mastering Sed, Awk, and Grep

A comprehensive guide to Unix text processing using Grep, Sed, and Awk. Learn how to use a sed tester online, awk tester online, and grep regex tester to master these powerful CLI tools with our ultimate cheat sheet.

2026-04-11

Unix Text Processing Master Guide: Mastering Sed, Awk, and Grep

In the world of Unix-like operating systems (Linux, macOS, BSD), text is the universal interface. Whether you are managing server configurations, analyzing log files, or automating complex data transformations, the "Holy Trinity" of text processing—Grep, Sed, and Awk—are your most powerful allies.

This guide provides a deep dive into these essential tools, offering practical examples, a comprehensive cheat sheet, and explaining why using an online playground is the fastest way to master them.

1. Grep: The Global Regular Expression Print

Grep is the simplest of the three, designed for one primary task: searching for lines that match a specific pattern (usually a regular expression).

Core Syntax

grep [options] "pattern" [file]

Common Use Cases

  • Searching logs: grep "ERROR" /var/log/syslog
  • Recursive search: grep -r "TODO" ./src
  • Case-insensitive search: grep -i "user" config.json
  • Counting matches: grep -c "keyword" data.txt

Why use a Grep Regex Tester?

Regular expressions can be notoriously tricky. A grep regex tester allows you to:

  • Visual Feedback: Instantly see which lines in your sample text match your pattern.
  • Explain Patterns: Many testers provide a breakdown of what each part of your regex does (e.g., ^ for start of line, \d+ for one or more digits).
  • Test Variants: Quickly switch between Basic (BRE), Extended (ERE), and Perl-compatible (PCRE) syntax to see how your environment might handle the pattern.

2. Sed: The Stream Editor

Sed is a non-interactive stream editor used for filtering and transforming text. It excels at search-and-replace operations across large files without opening them in a text editor.

Core Syntax

sed [options] 'command' [file]

The Famous 's' Command (Substitute)

sed 's/old_text/new_text/' filename

Note: Use s/old/new/g for global replacement (all occurrences in a line).

Common Use Cases

  • Replace text: sed 's/localhost/127.0.0.1/g' config.yaml
  • Delete lines: sed '5,10d' list.txt (deletes lines 5 to 10)
  • Insert text: sed '1i\HEADER' data.csv (inserts 'HEADER' at the first line)

Why use a Sed Tester Online?

Sed commands can become complex "one-liners" that are difficult to debug. A sed tester online or sed command builder is invaluable because:

  • Safety First: Test your substitution commands on sample data before running them with the -i (in-place) flag on your production files.
  • Complexity Management: Visualize how multiple commands piped together (e.g., sed -e '...' -e '...') affect the input stream.
  • Escape Character Help: Dealing with slashes, backslashes, and special characters in shell environments is a common source of bugs. Builders handle the escaping logic for you.

3. Awk: The Pattern Scanning and Processing Language

Awk is more than a command; it is a complete, data-driven programming language. It is designed for processing structured data (like CSV or log files) where text is organized into fields and records.

Core Syntax

awk [options] 'pattern { action }' [file]

Key Concepts

  • $0: The entire line.
  • $1, $2, ...: The first, second, etc., fields (columns).
  • NF: Number of Fields in the current record.
  • NR: Number of Records (line number) processed so far.

Common Use Cases

  • Print specific columns: awk '{ print $1, $3 }' data.tsv
  • Filtering by value: awk '$3 > 100 { print $1 }' sales.log
  • Calculating totals: awk '{ sum += $3 } END { print sum }' report.txt

Why use an Awk Tester Online?

Because Awk is a programming language, it involves variables, loops, and conditional logic. An awk tester online helps by:

  • Instant Output: See exactly how your print statements and calculations affect the output as you type.
  • Field Visualizer: Many testers show you exactly how Awk sees your "columns" based on different delimiters (tabs vs. spaces vs. commas).
  • Logic Debugging: It’s much easier to debug an if-else block in a web interface than by repeatedly running a script in the terminal.

Unix Text Processing Cheat Sheet

Task Tool Example Command
Search for a string Grep grep "pattern" file
Case-insensitive search Grep grep -i "pattern" file
Count lines with pattern Grep grep -c "pattern" file
Replace first occurrence Sed sed 's/old/new/' file
Replace all occurrences Sed sed 's/old/new/g' file
Delete specific line Sed sed '5d' file
Print 2nd column Awk awk '{print $2}' file
Sum values in 3rd column Awk awk '{sum+=$3} END {print sum}' file
Filter by 1st column length Awk length($1) > 10

Conclusion: When to use which?

  • Use Grep when you just need to find things.
  • Use Sed when you need to modify or transform lines.
  • Use Awk when you need to analyze data or perform calculations on fields.

For complex tasks, don't be afraid to pipe them together:

grep "ERROR" system.log | awk '{print $4}' | sed 's/\[//g'

Mastering these tools takes time, but using an online playground significantly flattens the learning curve. Happy processing!

Related Tools on Tool3M

  • Regex Tester: Test and debug your regular expressions for Grep, JavaScript, and more.
  • Text Diff: Compare text files to see the results of your transformations.
  • JSON Formatter: For modern structured data that goes beyond what simple Awk can handle.
Back to Blog