[totaltec]

It can be done I'm sure with pure CSS styling.

Consider these styles:
/* This creates the top border on the first cell only */
.products-table .product-name-row .product-cell {
border-top: 2px solid red;
}
/* Puts left and right borders on all the cells */
.products-table .product-cell {
border-left: 2px solid red;
border-right: 2px solid red;
}
/* Adds the bottom border to the last cell */
.products-table .product-cell-buynow {
border-bottom: 2px solid red;
}
I've worked this out using version 4.4.4. Your tables may be different, I could help more with a link to the page in question.

Also the table .products-table usually has a cellspacing assigned. If you have little gaps between the borders, you need to remove the cellspacing declared in the html of the template, and add some spacing back in with CSS.