The universe has always existed in roughly its current form, with matter continuously created to fill expanding space (steady-state theory).
The universe began in a hot, dense state approximately 13.8 billion years ago (the Big Bang). The Cosmic Microwave Background, discovered in 1965, confirmed this. Fred Hoyle, who coined 'Big Bang' mockingly, never fully accepted the evidence.