"According to the results, our house has decided to name Yoshihide Suga prime minister," lower house speaker Tadamori Oshima told parliament after the votes were counted, AFP reported.
Suga, 71, won an easy victory, taking 314 votes of 462 valid ballots cast in the lower house of parliament, where his ruling Liberal Democratic Party holds a commanding majority with its coalition partner.
He bowed deeply as lawmakers applauded following the announcement, but made no immediate comment.
He is expected to announce his cabinet later Wednesday, with local media reporting he will retain a number of ministers from Abe's government.
Suga has said he will prioritize keeping coronavirus infections under control and kickstarting Japan's economy, and has promised to continue Abe's key policy programs.