I have worked in the template\catalog\product\list\toolbar.phtml where you can change the total toolbar design. But there have a function
<?php echo $this->getPagerHtml() ?>
it’s for the pagination. if you want to change pagination html then go to the template\page\html\pager.phtml and you can change it from here.
本文：Magento 自定义分页代码 How to change pagination design in product listing page in magento