To Comets, KBO's, and Asteroids orbit the sun?

Most of the ones that are in our solar system do, though they can have highly elliptical orbits, especially comets. On occasion, a comet will p through our solar system but have a hyperbolic course, where they make just one p, i.e. not in an orbit.