Make a function that produces a regex pattern to identify URLs of interest

Suppose we are intending to scrape a job portal, [login to view URL], which virtually contains many external sublinks, such as: [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] The idea is to apply a difference checker algorithm which yields a generic regex that matches the above routes, considering variable parts of the URLs, based on whether they yielded jobs or not. Build a function, generatePattern(routes), where routes is an array of object having: URL: str hasYieldedJob: bool In the above example, all the links except the last 3 ones yielded jobs, so, the perfect (fictive pattern) regex would be: /job/{any number}/{any string}/?{any string} Case scenarios Query parameters should be considered as variables due to their complexity. We do not want to apply a constant rule upon them, even if in the given dataset of urls they are the same. So if we have “/job/foo?parameter=true”, pattern will be “/job/foo{any string}”. Additional brainstorming is welcome. - If routes contain hyphens, say ".../foo-bar/...", no matter if the part is invariant within the supplied urls, it will be considered as ".../{any string}/..."