Bash output redirection for Data Engineers

writing bash command output/error to file

Commands and scripts in a shell can generate two basic types of outputs:

STDOUT: The normal output from a command
STDERR: The error output from a command

In most of the scenarios, in production, we would like to persist these outputs for debugging at a later point. For that, we can use bash redirection. Redirection means capturing output from a command or script and sending it as input to another file, command, program, or script.