Smash the black garlic and mix it with oyster sauce, soy sauce, sugar, pepper, and sesame oil. Heat a large skillet with oil over medium-high heat. When the oil shimmers add the ginger and cook for 1 minute. Add the mushrooms and cook until tender. Add the black garlic mixture and cook until the mushrooms are almost dry. Cool before filling the buns.