It seems that publishing a post of Linux tips & tricks is a rite of passage that all engineers must go through. More importantly, it's a bookmark for my future self to find these eclectic mix of commands easily with minimal googling.
So without further ado, here's my list:
find
This command is very helpful while searching for needles in a haystack. It also has plenty of modifiers (too many to list), so I'll only mention the ones I use almost daily.
The general syntax of the command is:
$ find <starting directory> \
-type <type of file/directory> \
-name "<Regex of the file/dir name>" \
-exec <arbitrary command to execute> {} \;
Basic example looking for java files:
$ find ~/projects -type f -name "*.java"
Example looking for directories called main
$ find ~/projects -type d -name "main"
We can also recursively execute a command on the matching files. This exposes the true power of the find command.
Example: Search all java files for the Main function. The output of this command will only be the matched strings.
$ find ~/projects -type f -name "*.java" -exec grep -i "Main" '{}' \;
Alternatively, if you wish to output the name of the matching file along with the matched string:
$ find ~/projects -type f -name "*.java" -exec grep -i "Main" '{}' +
Notice the difference in how the command ends. The braces '{}' are substituted by each matching file name at runtime. It's similar to how xargs works.
less
For log files (typically large) and files that I wish to only read and
NOT edit, I use the less command extensively. One of the major
reasons I love this command is, I can tail files without it
cluttering my terminal. This command also has the benefit of only
loading the file partially into memory, thereby making it a sleek
alternative to vi
Example:
$ less /var/log/insanely-large-log-file.log
Once inside, you can use G to go to the end of the file or use F to tail the file.
Alternatively, you can open & tail the file directly using
$ less +F /var/log/insanely-large-log-file.log
To quit and return to the terminal, use the normal vi command
<ESC> :q
entr
I recently came across this command and although it hasn't made it to my most frequently used commands, I think it's pretty useful. It would be a crime to compile such a list and not mention entr
This command allows users to execute an arbitrary script whenever a file changes. It's similar to watchr, guard & nodemon. Since entr is written in C, it's faster and more responsive on larger directories.
Usecases can range from running test cases whenever your source files change
$ ls *.c | entr 'make && make test'
or reloading the browser whenever an HTML file changes.
$ ls *.css *.html | entr reload-browser Firefox
You can also restart server processes using the -r modifier
$ ls *.rb | entr -r ruby main.rb
Check out more details here.
htop
If you are looking at your machine's performance in any way apart from
htop, you're doing it wrong. It's what top should have been all along. Although it's not built-in, you can easily install it via:
$ apt install htop
or
$ brew install htop-osx.
The output is very self-explanatory and easier to understand & sort.
jq
Your search for a JSON parser ends here. jq runs on a stream of JSON data. Each input is parsed as a sequence of whitespace-separated JSON values which are passed through each filter of jq. The filters themselves, can be combined in any way by piping the output of one filter to the input of another.
Example:
This example extracts the field 'foo' from the input JSON.
$ jq '.foo' {"foo": 42, "bar": "less interesting data"}
=> 42
This example extracts the 0th element of the JSON array.
$ jq '.[0]' [{"name":"JSON", "good":true}, {"name":"XML", "good":false}]
=> {"name":"JSON", "good":true}
vim commands
By popular opinion, vim is the awesomest editor in town. But for newbies, it can be a little daunting and un-friendly. Once you get vim, you'll never go back to any other editor.
The following vim commands aren't for newbies. It's for more advanced users.
How often do you open a file in vim to edit it and realize you should have opened it as root? You can use the following command to save your changes without exiting vim.
<ESC> :w !sudo tee %
Slightly longer to type but completely worth it.
I think vim commands demand a dedicated post to do justice to the most beloved editor.
Conclusion
I hope this was useful. I'll probably edit this post to reflect any new commands that cross my path/blow my mind.