Welcome to The Armory. Located directly on Perth Amboy's historic waterfront, The Armory is a hidden jewel that showcases a unique and beautiful view of the Raritan Bay and the New York borough of Staten Island. This completely restored naval ammunition building was once used during World Wars I & II and is now acclaimed to be one of New Jersey's finest historical treasures.