It sounds like you can ignore the task column, right? You just need to count the number of times a specific date appears in one column. That shouldn’t be too hard.
This should work although when I Live Test it, it returns twice the value it should (6 instead of 3):
I used this Airtable spreadsheet: