Would anyone worry if their neighbor was buying tons of fertilizer,gun powder, lye and nitrogen?

Yeah I would, but I'm sure a bunch of lunatic idiots would argue that he was just exercising his Second Amendment rights.