you need to add it to home.tpl in the left sidebar section, then put a conditional if statement around it so that it only shows only show on the pages you want.
probably this would work.
{if $cat ne ''}<div><img src="{$ImagesDir}/yourimage.jpg" alt="" />{/if}