Templates are supposed to go into app/templates, not into addon/templates.
AFAIK code in addon lives in the addon’s own namespace, which is implemented using ES6 modules. Hence you to have to import the component in app/components. But Handlebars templates have no notion of being namespaced, since they are not ES6 modules.