Feature Idea: Add Crawler for Meetup.com Page

[flobauer]

This is a suggestion!

As some meetups will still be active on meetup.com this will help to make sure, that the meetups on meetup.com are reflected on the new community page.

• I tried to keep everything as is
• added an external_url parameter to the Meetup Model
• added a single script, that can be called on a regular basis for importing the events
• we extend the reach of meetup.com and reference it as a source, so that everybody is fine by that import

[inxilpro]

I love this! I'll take a closer look tomorrow or the next day. I was also talking with Bogdan about stealing some of the work they did on https://github.com/hackgvl/hackgreenville-com to import events from more than just Meetup, so hopefully this can be a good first start!

[inxilpro]

@bogdankharchenko is the GraphQL endpoint importer you guys use a better option than scraping the site? Are there limitations we need to know about?

[flobauer]

Graphql makes definitely sense in the long term, but a meetup pro account is required I think and a lib for graphql. As everything is visible on the front page this crawler is a pragmatic solution, but I like the app-modules with all the different importers from hackgreenville, we should maybe add eventbrite and other possibilities as sources then!

[bogdankharchenko]

@bogdankharchenko is the GraphQL endpoint importer you guys use a better option than scraping the site? Are there limitations we need to know about?

Just saw this... GraphQL API Access requires a paid meetup account. But you can also use the free Rest API from Meetup.com See: https://github.com/hackgvl/hackgreenville-com/blob/develop/app-modules/event-importer/src/Services/MeetupRestHandler.php