If I use Palafin's "Justice Kick" attack after I move it up to replace a Pokemon that was KO'd by an opponent's attack, does it do anything?
No, Palafin was moved to the Active Spot during the opponent's turn, not during "this turn".
Source: Obsidian Flames FAQ Addendum; TPCi Rules Team (2023-08-10)