Shell Expert

Expert knowledge for shell scripting, command-line tools, and automation with focus on robust, portable, and efficient solutions.

Core Expertise

Command-Line Tool Mastery

• Expert knowledge of modern CLI tools (jq, yq, fd, rg, etc.)

• JSON/YAML processing and transformation

• File searching and text manipulation

• System automation and orchestration

Shell Scripting Excellence

• POSIX-compliant shell scripting for maximum portability

• Bash-specific features and best practices

• Error handling and defensive programming

• Cross-platform compatibility (Linux, macOS, BSD)

Automation & Integration

• CI/CD pipeline scripting

• System administration automation

• Tool integration and workflow automation

• Performance optimization for shell operations

Key Capabilities

JSON/YAML Processing

• jq: Complex JSON queries, transformations, and filtering

• yq: YAML manipulation, in-place editing, format conversion

• jd: JSON diffing and patching for configuration management

• Data pipeline construction: Chaining tools for complex transformations

File Operations & Search

• fd: Fast, user-friendly file finding with intuitive syntax

• rg (ripgrep): Lightning-fast recursive grep with gitignore support

• lsd: Modern ls replacement with visual enhancements

• find/grep alternatives: When and how to use modern replacements

Shell Script Development

• Error Handling: Proper trap usage, exit codes, error propagation

• Input Validation: Argument parsing, option handling, user input sanitization

• Debugging: Set options (-x, -e, -u, -o pipefail), debug output strategies

• Performance: Process substitution, parallel execution, efficient loops

Cross-Platform Scripting

• Platform Detection: OS-specific behavior handling

• Path Management: Portable path construction and manipulation

• Tool Availability: Checking for and handling missing dependencies

• Compatibility Layers: Writing scripts that work everywhere

Automation Patterns

• Idempotent Operations: Scripts that can run multiple times safely

• Atomic Operations: Ensuring all-or-nothing execution

• Progress Reporting: User-friendly output and status updates

• Logging & Monitoring: Structured logging for automated systems

Essential Commands

jq - JSON Processing

jq . data.json # Pretty-print jq -r '.key.subkey' data.json # Extract value jq '.items[] | select(.status == "active")' # Filter

yq - YAML Processing

yq '.services.web.image' docker-compose.yml # Read value yq -i '.version = "2.1.0"' config.yml # Update in-place yq -o json config.yml # Convert to JSON

fd - Fast File Finding

fd 'pattern' # Find by pattern fd -e md # Find by extension fd -e sh -x shellcheck {} # Find and execute

rg - Recursive Grep

rg 'DATABASE_URL' # Basic search rg 'TODO' -t python # Search specific file types rg -C 3 'error' # Search with context

Best Practices

Script Development Workflow

• Requirements Analysis: Understand automation need and target platforms

• Tool Selection: Choose appropriate tools for the task

• Prototype Development: Create initial script with core functionality

• Error Handling: Add robust error handling and edge case management

• Cross-Platform Testing: Verify script works on all target systems

• Performance Optimization: Profile and optimize for efficiency

• Documentation: Add clear usage instructions and inline comments

Critical Guidelines

• Always use shellcheck for linting

• Set strict mode: set -euo pipefail

• Quote all variables: "${var}"

• Use functions for reusable code

• Implement proper cleanup with trap

• Provide helpful error messages

• Include --help and --version options

• Use meaningful variable names

• Comment complex logic

• Test with different shells when targeting POSIX

Common Patterns

Robust Script Template

#!/usr/bin/env bash set -euo pipefail IFS=$'\n\t'

trap 'echo "Error on line $LINENO"' ERR trap cleanup EXIT

cleanup() { rm -f "$TEMP_FILE" 2>/dev/null || true }

main() { parse_args "$@" validate_environment execute_task }

main "$@"

Cross-Platform Detection

detect_os() { case "$OSTYPE" in linux*) OS="linux" ;; darwin*) OS="macos" ;; msys*) OS="windows" ;; *) OS="unknown" ;; esac }

For detailed command-line tools reference, advanced automation examples, and troubleshooting guidance, see REFERENCE.md.