It has on display a good number of ancient Indian paintings, coins, fabrics, arms, artifacts, etc. The museum collection is huge and has some fine sculptures from the excavation at Bhokardan, a nearby historic site.
Where it is
Located on the University campus. - North of the Botanical Garden
Things to know before your trip to History Museum - Dr. Babasaheb Ambedkar Marathwada University
Rules that catch travellers out: liquor, permits, passes, phones, dress and customs. Each one names its source.
Law
Liquor is banned in Bihar, for visitors too
Under the Bihar Prohibition and Excise Act, 2016, nobody may make, sell, buy, carry, keep or drink liquor anywhere in Bihar. This covers people from other States and foreigners, and you cannot bring liquor in.
Only visitors' own ratings are shown; JanWatchdog does not rate places or take money for reviews. See this place on Google Maps, which has its own reviews.
Source: Wikivoyage, Aurangabad, written by volunteers (CC BY-SA 4.0), not a government source. Prices and timings may be old; confirm before you travel.