this post was submitted on 01 Jan 2024
57 points (98.3% liked)

Linux

46819 readers
1095 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS
 

I want to run a command and see all of its output on the left hand side, while simultaneously searching/grepping for particular lines on the right hand side. In other words, I want a temporary vertically split screen in my CLI, ideally with scrollback on each side of the split, but where I expect the left hand side to be scrolling thousands of lines quickly, while on the right hand side is a slow accumulation of "matches" to my grep.

Is this possible today? What tools would you recommend to accomplish this?

EDIT: To be clear, a one-liner is preferable over learning tmux or screen, although this does motivate me to perhaps begin learning tmux.

In case this is an X/Y problem: The specific command I'm trying to run is an rsync simulation (dry-run) where I want to both check that the command works, and subsequently check that there are no denied errors. The recommended way to do this is to run the command twice, as follows (but I want to combine it into one pass):

# first specify the "-n" parameter so rsync will simulate its operation. You should use this before you start:
rsync -naP --exclude-from=rsync-homedir-local.txt /home/$USER/ $BACKUPDIR/

# check for permission denied errors in your homedir:
rsync -naP --exclude-from=rsync-homedir-local.txt /home/$USER/ $BACKUPDIR/ | grep denied
all 22 comments
sorted by: hot top controversial new old
[–] [email protected] 43 points 7 months ago* (last edited 7 months ago) (1 children)

Run rsync, pipe to tee, and redirect the output to a named pipe (mkfifo). Open a second terminal and direct the named pipe into a grep command. Arrange the terminals in whatever way you want.

mkfifo mypipe
rsync | tee mypipe
grep "denied" < mypipe
[–] [email protected] 3 points 7 months ago

Elegant and flexible, thank you!

[–] [email protected] 25 points 7 months ago (1 children)

Tmux is a very helpful terminal multiplexer, meaning it can split your terminal into multiple panes. So, create two side by side panes, then one way of doing it is:

  • on the left, run your cmd | tee >(grep 'denied' > error.log)
  • on the right, run tail -f error.log

The tee process takes it's standard in, and writes itbto both standard out, so you see all the lines, and the path it's been given. The >(...) operator runs the grep in a subprocess, and returns the path to it's standard input pipe, so grep receives every line, and writes the denied lines to a log file which you display with tail in the other pane.

Rather than using a file for error.log you could also use a named pipe in much the same way.

[–] [email protected] 1 points 7 months ago (1 children)

Thanks! I'm curious if there is a way to do this as a one-liner?

[–] [email protected] 2 points 7 months ago (1 children)

Sorry for th slow answer, I've been away. There is a way, if it's still useful to you:

First, create a named fifo, you only need to do this once:

mkfifo logview

Run your rsync in one pane, with a filtered view in the second:

tmux new 'rsync ...options... |& tee logview' \; split-window -h 'grep "denied" logview'

Replace ...options... with your normal rsync command line.

That should give you a split view, with all the normal messages on the left, and only messages containing 'denied' on the right.

The |& makes sure we capture both stdout and stderr, tee then writes them to the fifo and displays them. split-window tells tmux to create a second pane, and display the output of grep.

[–] [email protected] 1 points 7 months ago
[–] [email protected] 9 points 7 months ago

I daresay there's a way to do something like this with fzf

[–] [email protected] 8 points 7 months ago

Given encouragement to try tmux, here is what I've come up with as a "one-liner" (script) that does what I was originally looking for:

#!/bin/sh

tmux new-session -d -s split_screen_grep \; \
  send-keys "/bin/sh -c '$1' | tee /tmp/split_screen_grep.txt" C-m \; \
  split-window -h \; \
  select-pane -t 1 \; \
  send-keys "tail -f /tmp/split_screen_grep.txt | grep '$2'" C-m \;

tmux attach-session -t split_screen_grep

I use it as follows, first arg is a command, second arg is a pattern to search for:

$ ./split-grep "cat big_file.txt" "tmux"
[–] [email protected] 7 points 7 months ago (1 children)

I usually solve this kind of problem by piping to less or a logfile and then just searching in there. You can get it to refresh new content by pressing the End key twice. Or maybe less just needs the -f flag or something similar. I'm too lazy to look it up.

[–] [email protected] 3 points 7 months ago* (last edited 7 months ago) (2 children)

less can enter a grep-like mode by hitting ~~/~~

Edit: it's &amp; for the grep mode, / is search.

[–] [email protected] 2 points 7 months ago (1 children)

More info: / only searches from cursor to end of file. ? searches from cursor to start of file.

[–] [email protected] 3 points 7 months ago

Oops yeah I just edited my comment, put the wrong symbol!

[–] [email protected] 1 points 7 months ago* (last edited 7 months ago) (1 children)

That's not at all grep-like. Grep is a line filter, not a character sequence highlighter.

[–] [email protected] 2 points 7 months ago

Oops sorry it's &amp;! / is find

[–] [email protected] 4 points 7 months ago (3 children)

ChatGPT suggests the following:

  1. Run tmux
  2. rsync -naP --exclude-from=rsync-homedir-local.txt /home/$USER/ $BACKUPDIR/ | tee /tmp/rsync_output.txt
  3. Ctrl+B % # splits screen vertically
  4. Ctrl+B right-arrow-key # moves to right split
  5. tail -f /tmp/rsync_output.txt | grep denied

Not quite a one-liner, but I can see how tmux is a big help here.

[–] [email protected] 7 points 7 months ago

I know this isn't an answer you're looking for, but I'll at least say that I find tmux to be infinitely useful and highly recommend checking it out

[–] [email protected] 6 points 7 months ago

Tmux is also good for long operations, as tmux is running as a server and you can close the terminal while tmux chugs away. Others can also connect to the tmux session through ssh and share screens.

[–] [email protected] 0 points 7 months ago

Don't feed the beast.

[–] [email protected] 2 points 7 months ago* (last edited 7 months ago)

Your request goes against the unix philosophy. Grep does one thing and does it well. If you desire additional functionality, you should add another utility to accomplish what you want.

rsync -naP --exclude-from=rsync-homedir-local.txt /home/$USER/ $BACKUPDIR/ | grep denied

In your specific task, utilize bashims to do (what I think) you want:

rsync -naP --exclude-from=rsync-homedir-local.txt /home/$USER/ $BACKUPDIR/ || echo "task failed"

[–] driveway 2 points 7 months ago

Skim has an interactive mode.

[–] [email protected] 2 points 7 months ago* (last edited 7 months ago)

Funnily enough Astrogrep on Windows is great for this