all you have to do is to clarify that it is not the temperature we measured using a thermometer.
And if the definition of temperature makes any sense, we expect it to satisfy some basic requirement, if object of T1 touches object of T2, with T1>T2, heat will flow from T1 to T2.
Physics doesn't depend on definitions. The concept of temperature doesn't depend on ideal gas also, which doesn't exist.