LibriVox is a voluntary project set up to record all books in the public domain and make them available, for free, in audio format on the internet. Besides the joy of having audio books, this is also very interesting from a speech/voice research perspective.
Another source for open-source text files is the French Incipit blog. Interestingly enough, I found a French version of Nicholas Cook’s introduction to music!