Starc, who was 12th man for the drawn tests in Brisbane and Adelaide, led the new-look pace attack with 2-27 from eight overs.
Hashim Amla was not out 11 at lunch and AB de Villiers yet to score. The South Africans only need to draw the Perth test to retain the No. 1 test ranking, while Australia needs a win to replace them.