How do I care for this strap?

As the FKM rubber is chemically stable and highly resistant to the elements, running it under water and cleaning with a lint-free cloth should do the trick.