Igniting LLM Performance: The Power of Domain Data!