Many times I have gone outreaching with just a small cadre of folks. Sometimes that has been a homegroup. At other times I have gone out with just a couple of friends who wanted to get some outreach experience. I regularly go out to serve with just one pastor who is curious about Servant Evangelism.
When we go out to serve with just a few people, one of the consistent comments we hear is “You people are everywhere! There must be hundreds of you!” That’s exactly what the Midianites thought when they saw Gideon’s 300 men surrounding their camp each armed with a torch and a clay pot (Judges 7). There is something powerful about projecting a large footprint even when we are small. The Kingdom of God is often like this. Peter and the early Church came across as larger than life as they went about doing good, teaching about Jesus, casting out demons and caring for the poor.
Be encouraged. You may only have a small group at this point as you go into the community. Later your numbers will swell and that will be fine, but in a sense, you are more pure, more powerful now with your few than you will ever be later when you have the luxury of greater momentum.