A Pampa man has been charged with arson after police said he set fire in the backyard of an abandoned building.