The anti-immigration party's 51 MPs instead sported an edelweiss, a white-and-yellow Alpine flower, in their lapels at the opening session of parliament following last month's elections.
The edelweiss stands for "courage, bravery and love," FPÖ leader Heinz-Christian Strache, who is set to become deputy premier in a likely coalition currently being negotiated with the conservatives, said on Wednesday.
Traditionally, like when parliament last opened after elections in 2013, FPÖ lawmakers have worn cornflowers, which matches the party's colours and which it said symbolises the ideals of the 1848 liberal revolutions in Europe.
However critics say that the cornflower is better known from being worn by Austrian Nazis as a secret way of recognising each other when they were banned in the 1930s, before Adolf Hitler annexed his native country in 1938.
The nationalist FPÖ was created by former Nazis in the 1950s and its first head was a former member of the SS.
Strache also flirted with neo-Nazism in his youth, although he now says he rejects all extremism and racism.
'A symbol of Austria'
Observers said that the FPOe's decision to abandon the cornflower is a further attempt to soften its image as it prepares to enter government as junior partners to incoming chancellor Sebastian Kurz, 31, of the centre-right.
"The cornflower played a certain role, also in the early day of the Nazi-era. The edelweiss, instead, is a symbol of Austria, as opposed to the cornflower," political analyst Thomas Hofer told AFP.
While few Austrians care little about such symbolism, Strache wanted to avoid more "media frenzy," Hofer added.
The edelweiss is also famous -- albeit only outside Austria -- as a song in the 1965 hit musical film "The Sound of Music" starring Julie Andrews about the von Trapp family's escape from Nazis in World War II.
The last time the FPÖ entered government, in 2000 under controversial then-leader Joerg Haider, there were major demonstrations and Austria was ostracised within the European Union for a time.
This time, however, the reaction is likely to be considerably more muted, with the FPÖ having toned down its rhetoric and Europe now much more inured to nationalist and populist parties.
On Thursday only around 200 anti-fascist protestors staged a demonstration in central Vienna carrying placards such as "Don't let Nazis govern" and "Fascism wears many colours".