Help, House has carpenter ants !!?

Just bought a house less than 2 month's ago, had a home inspection and everything turned out fine. Two months later working out in the attached garage I saw some sawdust in an unusual spot. Started probing around found lots of carpenter ants and missing wood. Is the seller or the inspector liable for any of this or am I screwed?