When I started my TS&R Jade campaign, I made a list of 20 randomly armed men-at-arms for the home town. When players wanted to hire some, I'd check their Charisma scores to see how many turned up, and have the players roll d20 however many times to determine who they got to hire that session. And of course, my sons helped me come up with funny names for many of them, like Yuseok (a Korean name that sounds like 'you suck') or Geun Hae (the name of the disgraced former president). Not all the names are Korean, and most are not jokey. But a good number of them are.
It didn't take long for repeat hires to appear. Players remembered the names, and this made them feel a little more attached.
It also didn't take long for the group to start losing men-at-arms in combat. If a repeat hire was slain, there was a bit more emotion behind it.
At first, I was replacing them. I'd erase the line with that character in my notebook, and come up with another one. I made a random table to roll for their weapons and armor (mostly not very good).
Early this year, after a particularly rough adventure for the men-at-arms, I told the players that this was it. I was replacing these guys, and that was it. The town of Pine Bridge was running out of young men and women willing to risk death for a bit of coin as hired guards/soldiers.
Nate had had his PC collect weapons and armor from some bandits they defeated, and he had been loaning these out to any hired men-at-arms to help with their AC and damage potential. But once I made it clear there would be no more replacements (at least not in Pinebridge Town), and men-at-arms continued to die, players hiring them started shelling out for better armors than the brigandine Saro (Nate's PC) was providing them. It helped that at 3rd to 5th level, they've got plenty of cash saved up.
Even that is not always enough. This past session, one of the men-at-arms was killed, despite wearing plate armor. The monsters got a good attack roll, and he only had 1hp, so he was gone. The players were a little bit upset that they had lost a man. Not terribly so, but there was a lot stronger reaction than there were in the earlier sessions when they thought there would always be a Hau En Wai to replace Nobuo, or a Nguyen to replace Jin Ping.
The men-at-arms are a useful resource, and making them memorable (even without personalities) then limiting their number has greatly increased their value in the players' eyes.