In Gardez, the capital of the eastern Paktia province, the Taliban attacked several police posts, leaving at least three policemen dead, said Gul Agha Roohani, the province's police chief.
The fall of Khawaja Omari to the Taliban extends their territory closer to the provincial capital, also called Ghazni, a city of 150,000 people 150 km (95 miles) southwest of the Afghan capital, Kabul.
The Taliban on Thursday afternoon had stormed a government chemical in a middle province, tripping an hours-long gunbattle that murdered 1-5, comprising three top rated officials.
Mujahid gave a higher casualty figure among the Afghan forces, which the Taliban often do, and a significantly lower death toll among the insurgent attackers. The district centre, however, is still in government hands.
He said eight government security forces were wounded in the fighting.
Confirming the report, Shindand District Governor Shukrullah Shaker said the attack took place in Larzanak area of the district.
The province of Ghazni is located south of Kabul province, the seat of the country's capital, Kabul, and lies along a key route.
The Taliban controls large swaths of Ghazni, a strategic province near the border with Pakistan.
Afghan Parliament member Mohammad Arif Rahmani said the district governor, intelligence service director and a deputy police official were killed in the attack, as well as 15 security forces.
Around 45 insurgents were also killed and several others wounded, he said, adding: "Taliban have set alight the district office complex, but reinforcement arrived at the district and now the situation under control".