Skip to content
0
  • Home
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
  • Home
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Sketchy)
  • No Skin
Collapse

Wandering Adventure Party

  1. Home
  2. Uncategorized
  3. https://OpenStreetMap.org has been disrupted today.

https://OpenStreetMap.org has been disrupted today.

Scheduled Pinned Locked Moved Uncategorized
openstreetmapddosscrapers
42 Posts 28 Posters 7 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • OpenStreetMap Ops TeamO This user is from outside of this forum
    OpenStreetMap Ops TeamO This user is from outside of this forum
    OpenStreetMap Ops Team
    wrote last edited by
    #1

    https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

    nag4wikaN geotuxG ISibboII RudiRastlosR JustinJ 17 Replies Last reply
    1
    0
    • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

      https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

      nag4wikaN This user is from outside of this forum
      nag4wikaN This user is from outside of this forum
      nag4wika
      wrote last edited by
      #2

      @osm_tech cc telecomix

      nag4wikaN The DoctorD 2 Replies Last reply
      0
      • nag4wikaN nag4wika

        @osm_tech cc telecomix

        nag4wikaN This user is from outside of this forum
        nag4wikaN This user is from outside of this forum
        nag4wika
        wrote last edited by
        #3

        @osm_tech cc @LaQuadrature

        1 Reply Last reply
        0
        • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

          https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

          geotuxG This user is from outside of this forum
          geotuxG This user is from outside of this forum
          geotux
          wrote last edited by
          #4

          @osm_tech thanks for the good work

          1 Reply Last reply
          0
          • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

            https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

            ISibboII This user is from outside of this forum
            ISibboII This user is from outside of this forum
            ISibboI
            wrote last edited by
            #5

            @osm_tech the scrapers don't know that you can torrent the whole OSM for free, without ddosing the webservice

            OpenStreetMap Ops TeamO Barry RowlingsonG 2 Replies Last reply
            0
            • ISibboII ISibboI

              @osm_tech the scrapers don't know that you can torrent the whole OSM for free, without ddosing the webservice

              OpenStreetMap Ops TeamO This user is from outside of this forum
              OpenStreetMap Ops TeamO This user is from outside of this forum
              OpenStreetMap Ops Team
              wrote last edited by
              #6

              @ISibboI Correct. Not an ounce of brain. It has been going on for months, but it is just getting worse. Waste of their resources/time and ours.

              Petri SalmelaP Jonas :debian: :norway_fb:J Not meN 3 Replies Last reply
              0
              • ISibboII ISibboI

                @osm_tech the scrapers don't know that you can torrent the whole OSM for free, without ddosing the webservice

                Barry RowlingsonG This user is from outside of this forum
                Barry RowlingsonG This user is from outside of this forum
                Barry Rowlingson
                wrote last edited by
                #7

                @ISibboI @osm_tech Is there a torrent for the tiles? Or just the world file? Are they scraping tiles?

                OpenStreetMap Ops TeamO 1 Reply Last reply
                0
                • Barry RowlingsonG Barry Rowlingson

                  @ISibboI @osm_tech Is there a torrent for the tiles? Or just the world file? Are they scraping tiles?

                  OpenStreetMap Ops TeamO This user is from outside of this forum
                  OpenStreetMap Ops TeamO This user is from outside of this forum
                  OpenStreetMap Ops Team
                  wrote last edited by
                  #8

                  @geospacedman @ISibboI They are scraping the website pages: /ways/, /nodes/ and /relations/. All this data is published on planet.osm.org already.

                  Barry RowlingsonG ideogramI 2 Replies Last reply
                  0
                  • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                    @geospacedman @ISibboI They are scraping the website pages: /ways/, /nodes/ and /relations/. All this data is published on planet.osm.org already.

                    Barry RowlingsonG This user is from outside of this forum
                    Barry RowlingsonG This user is from outside of this forum
                    Barry Rowlingson
                    wrote last edited by
                    #9

                    @osm_tech @ISibboI Oh that's so much worse than I'd imagined.

                    1 Reply Last reply
                    0
                    • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                      https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                      RudiRastlosR This user is from outside of this forum
                      RudiRastlosR This user is from outside of this forum
                      RudiRastlos
                      wrote last edited by
                      #10

                      @osm_tech ๐Ÿซฃ thank you for your work!

                      1 Reply Last reply
                      0
                      • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                        https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                        JustinJ This user is from outside of this forum
                        JustinJ This user is from outside of this forum
                        Justin
                        wrote last edited by
                        #11

                        @osm_tech
                        https://www.bleepingcomputer.com/news/security/new-linux-botnet-sshstalker-uses-old-school-irc-for-c2-comms/

                        Wonder if related.

                        OpenStreetMap Ops TeamO 1 Reply Last reply
                        0
                        • JustinJ Justin

                          @osm_tech
                          https://www.bleepingcomputer.com/news/security/new-linux-botnet-sshstalker-uses-old-school-irc-for-c2-comms/

                          Wonder if related.

                          OpenStreetMap Ops TeamO This user is from outside of this forum
                          OpenStreetMap Ops TeamO This user is from outside of this forum
                          OpenStreetMap Ops Team
                          wrote last edited by
                          #12

                          @justin No. Background: https://diff.wikimedia.org/2025/04/01/how-crawlers-impact-the-operations-of-the-wikimedia-projects/ and https://cloud.google.com/blog/topics/threat-intelligence/disrupting-largest-residential-proxy-network

                          1 Reply Last reply
                          0
                          • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                            https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                            Maya LandsmanM This user is from outside of this forum
                            Maya LandsmanM This user is from outside of this forum
                            Maya Landsman
                            wrote last edited by
                            #13

                            Oof, sorry you are dealing with that load. Beyond blocklists, caching tiles plus aggressive rate limits per ASN, and serving 429s with Retry-After can help. For bulk use, requiring API keys for heavy endpoints can also cut abuse. Thanks for keeping OSM running.

                            1 Reply Last reply
                            0
                            • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                              https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                              Joan-to-Debt Ratio ๐Ÿ˜ทC This user is from outside of this forum
                              Joan-to-Debt Ratio ๐Ÿ˜ทC This user is from outside of this forum
                              Joan-to-Debt Ratio ๐Ÿ˜ท
                              wrote last edited by
                              #14

                              @osm_tech Ugh, I am so sorry to hear this, and thank you to everyone working on this project.

                              Such a nightmare, and so completely pointless. ๐Ÿคฌ

                              1 Reply Last reply
                              0
                              • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                                @ISibboI Correct. Not an ounce of brain. It has been going on for months, but it is just getting worse. Waste of their resources/time and ours.

                                Petri SalmelaP This user is from outside of this forum
                                Petri SalmelaP This user is from outside of this forum
                                Petri Salmela
                                wrote last edited by
                                #15

                                @ISibboI @osm_tech I think, that spreading it on 100 000+ IP addresses tells they know they are doing shady thing.

                                G 1 Reply Last reply
                                0
                                • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                                  https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                                  George E. ๐Ÿ‡บ๐Ÿ‡ธโ™ฅ๐Ÿ‡บ๐Ÿ‡ฆ๐Ÿ‡ต๐Ÿ‡ธ๐Ÿณ๏ธโ€๐ŸŒˆ๐Ÿณ๏ธโ€โšง๏ธG This user is from outside of this forum
                                  George E. ๐Ÿ‡บ๐Ÿ‡ธโ™ฅ๐Ÿ‡บ๐Ÿ‡ฆ๐Ÿ‡ต๐Ÿ‡ธ๐Ÿณ๏ธโ€๐ŸŒˆ๐Ÿณ๏ธโ€โšง๏ธG This user is from outside of this forum
                                  George E. ๐Ÿ‡บ๐Ÿ‡ธโ™ฅ๐Ÿ‡บ๐Ÿ‡ฆ๐Ÿ‡ต๐Ÿ‡ธ๐Ÿณ๏ธโ€๐ŸŒˆ๐Ÿณ๏ธโ€โšง๏ธ
                                  wrote last edited by
                                  #16

                                  @osm_tech@en.osm.town
                                  Time to deploy Anubis in front of all the URLs that the scrapers are hitting.

                                  OpenStreetMap Ops TeamO 1 Reply Last reply
                                  0
                                  • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                                    https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                                    Tom ChadwinT This user is from outside of this forum
                                    Tom ChadwinT This user is from outside of this forum
                                    Tom Chadwin
                                    wrote last edited by
                                    #17

                                    @osm_tech Good luck, and thank you as always.

                                    1 Reply Last reply
                                    0
                                    • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                                      https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                                      Don Clemente ๐Ÿ”œ39C3 โ˜Ž๏ธ2470D This user is from outside of this forum
                                      Don Clemente ๐Ÿ”œ39C3 โ˜Ž๏ธ2470D This user is from outside of this forum
                                      Don Clemente ๐Ÿ”œ39C3 โ˜Ž๏ธ2470
                                      wrote last edited by
                                      #18

                                      @osm_tech wonder if it is collateral damage or intended, to get rid of alternative sources of information?
                                      Anyway, zip-bomb the hell out of them.

                                      OpenStreetMap Ops TeamO 1 Reply Last reply
                                      0
                                      • Don Clemente ๐Ÿ”œ39C3 โ˜Ž๏ธ2470D Don Clemente ๐Ÿ”œ39C3 โ˜Ž๏ธ2470

                                        @osm_tech wonder if it is collateral damage or intended, to get rid of alternative sources of information?
                                        Anyway, zip-bomb the hell out of them.

                                        OpenStreetMap Ops TeamO This user is from outside of this forum
                                        OpenStreetMap Ops TeamO This user is from outside of this forum
                                        OpenStreetMap Ops Team
                                        wrote last edited by
                                        #19

                                        @Don_Clemente Just dumb scrapers. They want our data, so maybe we /should/ redirect them to the latest full history planet file, it is only 245GB ๐Ÿ˜‰

                                        Don Clemente ๐Ÿ”œ39C3 โ˜Ž๏ธ2470D Ivรกn Sรกnchez OrtegaI 2 Replies Last reply
                                        0
                                        • George E. ๐Ÿ‡บ๐Ÿ‡ธโ™ฅ๐Ÿ‡บ๐Ÿ‡ฆ๐Ÿ‡ต๐Ÿ‡ธ๐Ÿณ๏ธโ€๐ŸŒˆ๐Ÿณ๏ธโ€โšง๏ธG George E. ๐Ÿ‡บ๐Ÿ‡ธโ™ฅ๐Ÿ‡บ๐Ÿ‡ฆ๐Ÿ‡ต๐Ÿ‡ธ๐Ÿณ๏ธโ€๐ŸŒˆ๐Ÿณ๏ธโ€โšง๏ธ

                                          @osm_tech@en.osm.town
                                          Time to deploy Anubis in front of all the URLs that the scrapers are hitting.

                                          OpenStreetMap Ops TeamO This user is from outside of this forum
                                          OpenStreetMap Ops TeamO This user is from outside of this forum
                                          OpenStreetMap Ops Team
                                          wrote last edited by
                                          #20

                                          @gme Anubis is great, but not ideal for us. We have reasonable technical mitigations in place, but it is unfortunately an arms race (and time/resource blackhole)

                                          1 Reply Last reply
                                          0

                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post