Answer is: Yes. A common mistake for many new believers is not going to church. The church is not an organisation or a business, but is made up of families of people, helping each other grow in all aspects of life, and fullness of understanding of who God is and His word. 

The dangers for not going to church
• Mis-reading or mis-understanding of the Bible in the wrong context.
• Come up with your own beliefs of who God is. Your beliefs becomes your own god.
• No accountability or fellowship with others.
• No spiritual covering, and cannot be ministered to, when in time of need.

It was never God's plan to have lonely Christians. In the Bible, it says:
Two are better than one, Because they have a good reward for their labor. For if they fall, one will lift up his companion. But woe to him who is alone when he falls, For he has no one to help him up.
Ecclesiastes 4:9-10

Caution: Electronic Church
Being a cyber-Christian (watching or listening to sermons on the internet), is sometime known as a lone-ranger Christian. Hence we live in a age, where you can even switch on the TV and watch church, alone in your shorts. However, part of the Christian walk is about relationships with others, which is a practical demostration of your Christian walk.

Going to church is not a religious act, but being part of a community and be connected.
• Fellowship, friendship and encouragement with other believers.
• A place to ask questions in your Christian growth.
• Ministered to and receive prayer by leaders for your needs.
• A place where you can be a blessing; helping and serving others.
• Full understanding of His word, hence able to discern.
• Place for corporate worship and prayer.

The Bible says. Speaking the truth in love, may grow up in all things into Him who is the head—Christ from whom the whole body, joined and knit together by what every joint supplies, according to the effective working by which every part does its share, causes growth of the body for the edifying of itself in love. Ephesians 4:15-16

Where do I start? There are many good churches to choose from. Take your time in finding the right church by asking and praying to God for direction. Here are a few pointers in finding a good Church.
• Read and understand the church's vision, doctrine and mission.
• A leader of the church (Senior Pastor) who is humble and not self seeking.
• A church which works with other pastors outside his church.
• A church which is balanced in both the Word of God as well as the Spirit.
• Teaches both the New Testament and Old Testament.
• A church which works with other outside churches, pastors and ministries.
• A place without many religious symbols or images (A person on a cross).

Sadly many new believers do get deceived. Watch out for the following characteristics:
• A church who believe they are the only chosen church from God.
• Self-righteous church that is isolated from outside churches and ministries.
• Their doctrines or books which are more or equal important than the Bible.
• Unusual rituals or religious practices which have no meanings.
• Once saved, always saved doctrine, or hyper grace.
• Ministers and pastors which are controlling, and they believe they are true messengers of God.
• Financial statements that are not declared in public during Annual General meetings.