Text this: Interferometric measurements of many-body topological invariants using mobile impurities