The 23-year-old was born in Sydney, raised in Darwin and is an Australian rules football fan without a hint of a Kiwi accent.
But Bayliss threw in his lot with his late father's homeland a few years ago and earned a surprise spot on New Zealand's Paris Olympics squad.
Getting a maiden call-up for Bazeley's senior squad is another pleasant surprise for Bayliss, who will push for selection in World Cup warm-ups against Finland next week and Chile a few days later at Eden Park.
"It was sort of out of the blue because I haven't been called up for any camps," Bayliss told Reuters of his selection on Wednesday.
"Although I'd been playing well, I was hoping I'd done enough to be invited to the camp and, thankfully, I had, but it's still a surprise."
Bayliss may not be giving himself enough credit, having been a revelation during the Jets' stunning rise to the top of the A-League Men table this season.
The former Central Coast Mariners academy prospect netted five goals in a five-match burst in January and February and is in career-best form in his third season at the Jets.
With New Zealand missing their captain and all-time top goal-scorer Chris Wood with a long-term knee injury, Bazeley may hope Bayliss can add another dimension to their attack in the World Cup warm-ups.
Bayliss is certainly feeling more confident since being given licence to go forward for a Jets side with comfortably the most potent attack in the A-League.
"It's been more of a positional shift. Throughout my first 50 or so A-League games, I've been playing a lot deeper than I probably have in my younger career," he said.
"I definitely regard myself as more of an attacking midfielder, but I think I'm a very versatile player who can do a job in a number of positions.''
Bayliss has shown a gift for timing on field and off to earn his New Zealand chance only months out from the All Whites' return to the World Cup for the first time since 2010.
New Zealand are pooled with Iran, Belgium and Egypt, though Iran's participation is under a cloud.
His birth nation Australia will also feature at the tournament co-hosted by the US, Canada and Mexico.
Bayliss said he never had discussions with Australia's international coaches since junior levels and will be proud to wear New Zealand's silver fern on his chest.
"It's definitely nice that I have a good connection to both countries," he said.
