Skip to main content

All Questions

Tagged with
1 vote
1 answer
155 views

Speed up grep usage inside bash script

I am currently working on creating a bash script that is supposed to process large log files from one of my programs. When I first started the script took around 15 seconds to complete which wasn't ...
Dzamba's user avatar
  • 11
4 votes
3 answers
116 views

Script optimisation to find duplicates filename in huge CSV

I have several CSV file from 1MB to 6GB generated by inotify script with a list of events formatted as is: timestamp;fullpath;event;size. Those files are formatted like this : timestamp;fullpath;...
Kiwy's user avatar
  • 9,764
1 vote
2 answers
624 views

Does zgrep reuse recently uncompressed files?

I am calling zgrep over *.gz files in a for loop in one directory. As the log files are huge (about 1GB each, and about 30 files), the command is taking a long time. I see several uncompressed files ...
mtk's user avatar
  • 27.8k
2 votes
0 answers
396 views

How do backreferences slow down regular expression search?

Let's say I have a text file with 20 chars per line like this: wertzuiopasdfghjkl< asdfghjkl<yxcvbnm,.- <yxcvbnm,.-123456789 1234567890QWERTZUIOP QWERTZUIOPASDFGHJKL< and so on ... and ...
Philippos's user avatar
  • 13.5k