In the new animated prequel to the hit family franchise, Chris Evans voices Buzz Lightyear, the fictional space hero whom the toy Buzz (voiced in the Toy Story films by Allen, 69) is based on.
"The short answer is I've stayed out of this 'cause it has nothing to do [with my character]," Allen told Extra of the new film in an interview published Wednesday.
"This is a whole new team that really had nothing to do with the first movies," he added.
Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human-interest stories.
TIBRINA HOBSON/AFP via Getty; Pixar Tim Allen; Lightyear (2022)
The actor went on to say that he originally thought Lightyear would be "live action," with "real humans."
But at the end of the day, "There's really no Toy Story Buzz without Woody," Allen said, shouting out Buzz's enemy-turned-friend sheriff toy (voiced over the years by Tom Hanks).
And while he thinks the new film has "a wonderful story," Allen noted, "It just doesn't seem to have any connection to the toy."
"I wish there was a better connection," he said.
RELATED VIDEO: Tim Allen on What the Toy Story Franchise Means to Him and Costar Tom Hanks: "We've Become Woody and Buzz"
Disney/Pixar's Lightyear, in theaters now, tells the origin story of the Space Ranger hero who inspired the toy, voiced by Allen in the Toy Story films. Here, he's played by Captain America alum Evans, 41, who said he was a "kid in a candy store" getting to be part of the project.
"The movie Toy Story was such an impactful film. It's so iconic and the characters had such variety. They just offer something that's so relatable," said Evans in a Lightyear behind-the-scenes featurette shared exclusively with PEOPLE earlier this month.
"This film is the origin story of Buzz Lightyear. It's the story that made Andy and his friends want to go buy a Buzz Lightyear toy," he added. "I'm a massive Pixar fan. ... It's unlike any Pixar movie to date."