To have a specific shipping cost for each product, you can enter the cost of shipping into the product record itself.
For each individual product, you just need to place the shipping cost into the Weight field.