I'm the New Neighbor, Would it be weird to write a letter to my new neighbors?

that's weird sending them a letter just to tell them about your music. Go to their apartment and introduce your self and tell them about your music.