A 500cc single can indeed hurt you. My first ride on a real motorcycle was a BSA Goldstar flat track bike that was raced locally very frequently. The owner took me on a very hair raising ride through the orange groves, him standing and me on the pillon seat holding on for dear life.
https://www.tm-img.com/image/cG8yRI spent a lot of time riding in the desert with this one and it never hurt me.
https://www.tm-img.com/image/Y7fvthttps://www.tm-img.com/image/cG1sNI took this into Mexico riding the trails and beaches in Baja. A lot of fun, smaller but I could get into trouble with it because I was to relaxed.