No, you should not hand in your CV (also commonly called a resume) in person.
Most medium and large-sized companies only accept online applications because they are easier for People and Culture managers to store.
Small businesses, local stores and independent coffee shops are likely to accept CVs submitted in person.
If you do hand in your CV in person, make sure you give the employer a great first impression. Wear something neat and tidy, like a collared shirt and pants, practice what you plan to say, and offer a handshake if there is an opportunity (and it is COVID appropriate).