Over his long term as manager, Baranov tried to resign several times. Twice, a replacement had been sent from St. Petersburg, but both died on the long journey to Alaska. In 1818, the ill and 71-year-old Baranov was finally replaced. Baranov was well-loved by many who worked closely with him, but he also had made enemies with the clergy and visiting naval officers. The ship bringing his replacement as governor, also brought an accountant to check into charges of corruption and theft by Baranov.
An extensive seven-month audit of the company accounts found them perfectly in balance. It also found that Baranov, far from having a fortune hidden away, was so poor he could not even support himself in retirement. Over his tenure, he had used all his money on the colony: paying personally to set up the school in Sitka and for the education in Russia of the most talented boys, paying the debts of men in financial distress, supplementing the pay of his best managers with his own company shares, and personally importing hundreds of cattle as a gift to Aleuts. After his replacement, Baranov chose to return to Russia for his retirement. But the sick Baranov died in Indonesia on the return voyage.
The Baranov era built the foundations of Russian-America. During this time, the colony progressed from its first settlement to a network of posts that stretched from the Bering Sea coast to California. Its capital, Sitka, was the largest city for thousands of miles in any direction. Schools and churches across the colony were creating a new culture. The final period of the Russian era would be built on these foundations Baranov had helped to lay down.