Austrian rail employees and passers-by witnessed the incident, grabbed the 24-year-old man, and alerted police.
The eight-week-old mixed breed puppy was rescued from the bin on platform five on Wednesday and taken to the police station, before being handed over to the Vienna Animal Protection Association, WTV.
"The puppy is unharmed, but we need to treat him for mites," said Louise Petrovic from WTV.
"We've found a good home for him where he can go next week and have a good life," she added.
The man - reported to be Romanian - was set free after being given a warning about cruelty to animals.