Only if you are properly protected. While most foam style padding I have seen does not contain latex, some did have a coating applied to them.
Some carpet backings have also been known to utilize latex so I would either leave it to someone else or as I said protect yourself.
For more information:
Read "Is there a way to test air in your house for latex exposure?" a Q&A answered by Andrea Palmer.