Mustards and horseradishes are a completely different type of hot and they are much shorter lived and mostly affect the nasal passages. It has something to do with the converting of sulfurs. They don't contain any capsaicin.
Chile peppers all originated from the Americas and Columbus was one of the first Europeans to encounter them and is often credited with referring to them as peppers. They are a fruit in the Nightshade family.