Suspended For 5 Days In Freshman Year, Does It Affect My Chances Of Getting In A Good College?

I was suspended for 5 days for fighting. It's my freshman year and I excel greatly academically. My GPA is about 3.8 maybe a 3.7 at the lowest. I got suspended for fighting and don't plan on getting suspended again and to stay suspension free for the next 3 years. But will this affect my chances of getting into a nice college even if I do well academically. I think that the colleges only look at your junior and senior year and check out the SAT and PSAT scores as well as your GPA and such but I'm just guessing. I'm really hoping this doesn't affect my future for a mistake like this. I'm hoping that since it's only my freshman year it won't mean much and as long as I don't repeat mistakes like this which leads to suspensions I would be fine but that is from a very optimistic view. Thank you for your answers.