Skip to content
0
  • Home
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
  • Home
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Sketchy)
  • No Skin
Collapse

Wandering Adventure Party

  1. Home
  2. Uncategorized
  3. https://OpenStreetMap.org has been disrupted today.

https://OpenStreetMap.org has been disrupted today.

Scheduled Pinned Locked Moved Uncategorized
openstreetmapddosscrapers
42 Posts 28 Posters 7 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

    https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

    WTLW This user is from outside of this forum
    WTLW This user is from outside of this forum
    WTL
    wrote last edited by
    #24

    @osm_tech @lehtimaeki I wonder if anyone has looked at the various AI browsers out there to see if they're used for active scraping.

    1 Reply Last reply
    0
    • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

      @Don_Clemente Just dumb scrapers. They want our data, so maybe we /should/ redirect them to the latest full history planet file, it is only 245GB 😉

      Iván Sánchez OrtegaI This user is from outside of this forum
      Iván Sánchez OrtegaI This user is from outside of this forum
      Iván Sánchez Ortega
      wrote last edited by
      #25

      @osm_tech @Don_Clemente Replacing the actual data with Null Island data that points to planet.osm.org is not a dumb idea IMHO

      1 Reply Last reply
      0
      • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

        https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

        Martin RustM This user is from outside of this forum
        Martin RustM This user is from outside of this forum
        Martin Rust
        wrote last edited by
        #26

        @osm_tech Block all read access except from registered users? And be restrictive on whom to grant an account (captcha, verified email address)?

        Open RiskO 1 Reply Last reply
        0
        • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

          https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

          Bill WoodcockW This user is from outside of this forum
          Bill WoodcockW This user is from outside of this forum
          Bill Woodcock
          wrote last edited by
          #27
          @osm_tech

          Please, please, AI bubble, burst already, so we can stop seeing this kind of vandalism.
          1 Reply Last reply
          0
          • nag4wikaN nag4wika

            @osm_tech cc telecomix

            The DoctorD This user is from outside of this forum
            The DoctorD This user is from outside of this forum
            The Doctor
            wrote last edited by
            #28

            @osm_tech @nag4wika Yuh?

            ~~~==:}}

            1 Reply Last reply
            0
            • Don Clemente 🔜39C3 ☎️2470D Don Clemente 🔜39C3 ☎️2470

              @osm_tech yes, but that's heavy on your resources and bandwidth. A zip file of 10GB Zeros is much more resource-efficient on your side 😉

              The DoctorD This user is from outside of this forum
              The DoctorD This user is from outside of this forum
              The Doctor
              wrote last edited by
              #29

              @osm_tech @Don_Clemente Can confirm. >:D

              1 Reply Last reply
              0
              • Martin RustM Martin Rust

                @osm_tech Block all read access except from registered users? And be restrictive on whom to grant an account (captcha, verified email address)?

                Open RiskO This user is from outside of this forum
                Open RiskO This user is from outside of this forum
                Open Risk
                wrote last edited by
                #30

                @martinrust

                had a similar issue with a much, much smaller wiki server (😅 ) but facing the same anonymous scrapers coming from thousands of random IP's.

                Couldn't find a way to keep them from crashing the server, so now access is by registration only.

                Very disruptive, this "AI" race to the bottom destroyed the open internet 😟

                @osm_tech

                1 Reply Last reply
                0
                • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                  https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                  Air Quotes ComedianA This user is from outside of this forum
                  Air Quotes ComedianA This user is from outside of this forum
                  Air Quotes Comedian
                  wrote last edited by
                  #31

                  @osm_tech I went to use OpenStreetMap today to get directions but it asked me to sign up/ log in, so I used Mapquest instead which doesn't.

                  OpenStreetMap Ops TeamO 1 Reply Last reply
                  0
                  • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                    @ISibboI Correct. Not an ounce of brain. It has been going on for months, but it is just getting worse. Waste of their resources/time and ours.

                    Jonas :debian: :norway_fb:J This user is from outside of this forum
                    Jonas :debian: :norway_fb:J This user is from outside of this forum
                    Jonas :debian: :norway_fb:
                    wrote last edited by
                    #32

                    @osm_tech @ISibboI Scraping the OpenStreetMap website gives of the same vibe as stealing free stuff.

                    Link Preview Image
                    1 Reply Last reply
                    0
                    • Air Quotes ComedianA Air Quotes Comedian

                      @osm_tech I went to use OpenStreetMap today to get directions but it asked me to sign up/ log in, so I used Mapquest instead which doesn't.

                      OpenStreetMap Ops TeamO This user is from outside of this forum
                      OpenStreetMap Ops TeamO This user is from outside of this forum
                      OpenStreetMap Ops Team
                      wrote last edited by
                      #33

                      @Air_Quotes_Comedian Weird. We don't require login for directions.

                      Link Preview Image
                      Air Quotes ComedianA 1 Reply Last reply
                      0
                      • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                        @Air_Quotes_Comedian Weird. We don't require login for directions.

                        Link Preview Image
                        Air Quotes ComedianA This user is from outside of this forum
                        Air Quotes ComedianA This user is from outside of this forum
                        Air Quotes Comedian
                        wrote last edited by
                        #34

                        @osm_tech Hmmm.

                        Perhaps I'm the only one who is required to log in for directions.

                        MapAm💜reM 1 Reply Last reply
                        0
                        • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                          https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                          ForestF This user is from outside of this forum
                          ForestF This user is from outside of this forum
                          Forest
                          wrote last edited by
                          #35

                          @osm_tech thank you for your service 🪖

                          1 Reply Last reply
                          0
                          • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                            @ISibboI Correct. Not an ounce of brain. It has been going on for months, but it is just getting worse. Waste of their resources/time and ours.

                            Not meN This user is from outside of this forum
                            Not meN This user is from outside of this forum
                            Not me
                            wrote last edited by
                            #36

                            @osm_tech @ISibboI isn't there a chance that service disruption is one of the objectives?

                            OpenStreetMap Ops TeamO 1 Reply Last reply
                            0
                            • Not meN Not me

                              @osm_tech @ISibboI isn't there a chance that service disruption is one of the objectives?

                              OpenStreetMap Ops TeamO This user is from outside of this forum
                              OpenStreetMap Ops TeamO This user is from outside of this forum
                              OpenStreetMap Ops Team
                              wrote last edited by
                              #37

                              @Notme @ISibboI We are not unique in battling these scrapers; Wikipedia, KDE, Gnome, OpenWRT, Arch Linux and many other projects have the some issue.

                              1 Reply Last reply
                              0
                              • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                                https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                                AssimilateborgA This user is from outside of this forum
                                AssimilateborgA This user is from outside of this forum
                                Assimilateborg
                                wrote last edited by
                                #38

                                @osm_tech I blocked user agents matching "Chrome.139.0.0.0 Safari.537.36" as this combination seems to not exist, except for millions of requests out of china.

                                1 Reply Last reply
                                0
                                • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                                  @geospacedman @ISibboI They are scraping the website pages: /ways/, /nodes/ and /relations/. All this data is published on planet.osm.org already.

                                  ideogramI This user is from outside of this forum
                                  ideogramI This user is from outside of this forum
                                  ideogram
                                  wrote last edited by
                                  #39

                                  @osm_tech
                                  Bloody idiots. I wonder if it's AI platforms?
                                  @geospacedman @ISibboI

                                  1 Reply Last reply
                                  0
                                  • OpenStreetMap Ops TeamO OpenStreetMap Ops Team

                                    https://OpenStreetMap.org has been disrupted today. We're working to keep the site online while facing extreme load from anonymous scrapers spread across 100,000+ IP addresses. Please be patient while we mitigate and protect the service. #OpenStreetMap #DDoS #Scrapers #AI

                                    P This user is from outside of this forum
                                    P This user is from outside of this forum
                                    parappappero
                                    wrote last edited by
                                    #40

                                    @osm_tech you should poison their data in some way

                                    1 Reply Last reply
                                    0
                                    • Air Quotes ComedianA Air Quotes Comedian

                                      @osm_tech Hmmm.

                                      Perhaps I'm the only one who is required to log in for directions.

                                      MapAm💜reM This user is from outside of this forum
                                      MapAm💜reM This user is from outside of this forum
                                      MapAm💜re
                                      wrote last edited by
                                      #41

                                      @Air_Quotes_Comedian

                                      That looks unusual. How about sharing the original OSM URL where you requested for directions?

                                      The only time the site will ask you to login is when you're trying to edit the map, all other operations can be used without an OSM account.

                                      Air Quotes ComedianA 1 Reply Last reply
                                      0
                                      • MapAm💜reM MapAm💜re

                                        @Air_Quotes_Comedian

                                        That looks unusual. How about sharing the original OSM URL where you requested for directions?

                                        The only time the site will ask you to login is when you're trying to edit the map, all other operations can be used without an OSM account.

                                        Air Quotes ComedianA This user is from outside of this forum
                                        Air Quotes ComedianA This user is from outside of this forum
                                        Air Quotes Comedian
                                        wrote last edited by
                                        #42

                                        @MapAmore Initial URL:
                                        https://www.openstreetmap.org/#map=12/37.8149/-88.5361

                                        Second URL: https://www.openstreetmap.org/directions#map=12/37.8149/-88.5361

                                        Tried something different this time and didn't click on the START MAPPING button (seemingly the obvious one to press).

                                        It worked and I didn't have to offer up a buccal swab trapped between two microscope slides.

                                        Thanks for that. 🙂

                                        Now I never have to use crappy old Mapquest again. It might not need a sign-in but it's awful.

                                        1 Reply Last reply
                                        0
                                        • Jürgen HubertJ Jürgen Hubert shared this topic

                                        Reply
                                        • Reply as topic
                                        Log in to reply
                                        • Oldest to Newest
                                        • Newest to Oldest
                                        • Most Votes


                                        • Login

                                        • Login or register to search.
                                        Powered by NodeBB Contributors
                                        • First post
                                          Last post