You want to start focusing on low-level programming: learn about C++ and assembly languages and cache behavior. Or possibly get into functional programming. I could see Haskell getting bigger in trading. Learning some statistics and math won't hurt.

I don't think there's a "too late", but there's a different skill set you need, especially to get a good job in finance.