Sydney Ibie had a good chance to give Daggers the lead in the first half, before Sam Ling’s own goal handed the visitors the points at Victoria Road.
And the loss left Daggers with only one point from a possible 12 and only a solitary goal at Chesterfield in those four games.
“You’re always upset when you lose a game. We’ve lost two on the bounce and it’s really gutting,” Young told the club website.
“The manager said it on Tuesday [after a 1-0 home loss to Bromley]. They’re probably some of our better performances with the ball, but we’re obviously not putting the ball in the back of the net.
“That’s what football is about and when anyone picks up the paper and see that we’ve lost it’s going to look worse than the performance told.”
Josh Rees put Daggers ahead at Chesterfield but they have now gone five and a half hours without finding the net since, after a goalless draw at Oxford City and successive home losses.
“We’ve gone one goal in four games, that’s not good enough as a collective,” added Young.
“Us as staff, we take responsibility first, but players, we’ve got to share it. Everyone is acutely aware of that, can see that.
“The last three games, Oxford City included, the quality of the performance, but unfortunately, what happens inside the 18-yard box is what matters. In our side and their side.”
Daggers endured a similarly difficult start to the campaign, taking just one point from their first four matches, before beating then leaders Barnet [1-0], Wealdstone [2-0] and AFC Fylde [3-1].
And Young says they can take heart from that as they look to turn things around at Halifax on Tuesday.
“We picked up the late one against Barnet, then went and won the next two,” he said.
“We missed one and then Hilly scored straight after against Fylde, big goals at big times, and at the minute we’re just not seeming to do that.
“We had a fantastic chance in the first half with Syd and that’s got to be a goal.
“We all know that, he knows that, but we don’t need to lose confidence in one another.
“We’ve got to keep that level of performance and what we’re doing in two-thirds of the pitch and we’ve got to bring it in that final third.
That’s where games change.
“We’ve got another game on Tuesday and this is the ferocious side of the league, you always have another game to turn it round.
“That’s the good side of it, but at the minute it doesn’t feel like it.
“It’d be easy for me to make up excuses about injuries but we deal with the cards we’re dealt and continue, put our best foot forward and try and get three points on Tuesday.”