Anything under about 38mm is generally considered small by current trends. That standard shifts over time and depends on wrist size too.
Vintage watches commonly ran 34 to 37mm and are having a real resurgence right now. What was once small is back in style.
The right size is really about your wrist, not what's trendy. A well proportioned 36mm can look better than an oversized 44mm.