Although the Bible was not "compiled" in a complete form that we see today in the first century. The teachings of Christ and the establishment of the church were documented and available to the first century Christians. Therefore the first century church was not "pre-biblical" as you put it. They had the original greek and hebrew writings, just not in the 66 book, chapter, verse form that you are used to. Granted, some of the epistles (letters) to the early church were written after the church was established, but these letters were read to the assemblies as were the scriptures from what we know as the Old Testament.
Also, you may want to check your Bible history. The Catholics did NOT give us the Bible. Early translations and canons were written and established long before the Roman Catholic Church came into being.
I. By around A.D. 100, God had given all the information to man that He was going to give (Jude 3; Rev. 22:18-19; II Pet. 1:3).
A. Immediately upon completion of these writings, copies were necessary (cf. Col. 4:16; I Thess. 5:27).
B. The only means of duplication until the fifteenth century (in A.D. 1454 Johannes Gutenburg invented the printing press) was by manual handwriting.
Marcion - the first attempt at a canon
While the books that now comprise the New Testament were in widespread use from the first century, it actually took quite a while to turn them into an official "canon". The first attempt at creating an official list of books for inclusion in the New Testament was by a gnostic shipowner named Marcion (c. 85 - c. 160 A.D.). As a gnostic, Marcion believed that there were two Gods in the universe - the God depicted in the Old Testament, and the God represented by Jesus in the New Testament. To accommodate these (and other) gnostic beliefs, Marcion created a list of books that he considered authoritative, based on his theological views. These included a condensed version of the Gospel of Luke (lacking the Nativity and Resurrection scenes), and 10 of Paul's letters. While the gnostic theology of Marcion was roundly condemned by the Early Church Fathers, his list was the first known attempt at defining a New Testament canon, and it prodded the Early Church Fathers to give greater consideration to those books that should be considered authoritative.
Muratori Canon (c. 200 A.D.)
One of the first known attempts by the Early Church Fathers to define a canon (and to refute the list postulated by Marcion) was in a fragmentary list (85 lines) dated to c. 200 A.D., named (after its 18th century discoverer, Lodovico Muratori) the Muratori Canon. The Muratori Canon is remarkably similar to our modern day New Testament, lacking only Philemon, Hebrews, James, I Peter, II Peter, and III John. The Muratori Canon also adds (curiously) the Old Testament Apocryphal book "Wisdom of Solomon", as well as the "Revelation of Peter" .
The canon of Athanasius (367 A.D.) contained the full New Testament list as we know it today.
Again, the Catholic Church relative to the Bible is prone to say, "If you accept the Bible, you must accept us for the Bible has been preserved by us and has come to you through us." My friends, the Lord is responsible for the preservation of His Word as He said, "Heaven and earth shall pass away: but My Words shall not pass away" (Mark 13:31). Should it even be granted that the Catholic Church were the agency through which the Word was preserved for a season, what would it signify? Further, should one be ready to concede that the Bible was handed to us, in a sense by the Catholic Church, does it follow that we must believe in the Catholic Church in order to accept the Bible? If I must repossess the newspaper from the mouth of my neighbor’s dog, does it follow that I must believe in my neighbor’s dog in order to accept what I read in the paper? Those who accept the Bible and the Bible alone plainly show that they reject all else.