Merlin’s weekly podcast with Dan Benjamin. We talk about creativity, independence, and making things you love.
Merlin’s weekly podcast with Dan Benjamin. We talk about creativity, independence, and making things you love.
”What’s 43 Folders?”
43Folders.com is Merlin Mann’s website about finding the time and attention to do your best creative work.
Text file question
mdl | Nov 7 2006
I've recently learned basic (read: remedial) command line and VIM controls and have really gotten into text files. Following up on year-old post on 43 folders (http://www.43folders.com/2005/08/17/life-inside-one-big-text-file), I'm intrigued by the idea of doing everything in big text files--dumping information into the file line by line, tagging it, and then relying on grep, sort, tr, sed and so on to manipulate and make sense of it. I can honestly say that I have never found a more powerful or flexible tool. (And just to think that it's been there all along, even when I shelled out big bucks for more complicated solutions. And don't even get me started on TeX. Yippee!) But my main question is: how big can a plain text file become before it grows too slow or unwieldy? Is there a practical limit to the size of text files? Obviously, this depends on the power of the system and the software used. I'm currently using an iBook G4 and VIM 7.0 from the command line. I'd like not to split up the file, if possible, but I suppose I may have to archive older lines at some point if it gets too slow. Any advice would be greatly appreciated! 4 Comments
POSTED IN:
But my main question is:...Submitted by jason.mcbrayer on November 8, 2006 - 2:28pm.
mdl;6549 wrote:
Many filesystems have a 2GiB limit on file size. You'd be hard pressed to fill a text file that full, of course. In practise, I can't imagine a text file so large that the standard unix text tools like grep would take any noticeable time to act on them (on a modern or even slightly obsolescent machine). You'll run into a problem organizing your text file long before that, if you ever deal with it in, e.g., a text editor rather than only with scripts and other command-line tools. Org-mode in Emacs helps quite a bit with this, though after a day of using it, the shown/hidden parts of the file can still be tangled like spaghetti, making it hard to find the next thing you want to refer to while still keeping the last thing open. » POSTED IN:
|
|
EXPLORE 43Folders | THE GOOD STUFF |