Can I clean fossil samples with acetone, or will this damage them?
It depends on what you want to use them for.
If you might someday want to extract DNA from them, or do some other chemical analysis, then it's probably a bad idea.
If you only want to display them, and you like the way they look after acetone treatment, then it should be OK.
Test on some samples you don't care about first.