Removing Duplicate Features in ArcGIS

I decided that a shortage of time has prevented me from actually posting commentary and process hints like I had anticipated.  Therefore, I will instead try to post hints and tips as I come across workarounds and tools in my daily geospatial tasks.  Here’s the first one:

Today’s hint is a simple one. Recently I downloaded a topologically awkward data set from BLM.  I had hoped to do a simple intersection of ownership with a study area, but the total acreage was too high.  As it turns out this data set has a one-to-many relationship of spatial features to database records represented by simply duplicating the spatial features for each database record.  For example, a single location with three owners has 3 identical polygons.  I think this is a common solution for what I would call “lazy” GIS design.  What I needed to do is simply remove the duplicates.  After my first-resort Google search, I found some obsolete scripts, commercial tools, and obtuse processes to fix the problem, but nothing really straightforward.  I then simply tried to look through the ArcToolbox to see what I could come up with.  There are the Find Identical and Delete Identical. Tools that looked promising, but the documentation indicates they are for duplicate values found in tables, not graphics.  On a hunch I tried using the Delete Identical tool but indicated the “Shape” column as one to find duplicates.  YEA, it worked.

  • First make a copy of your Feature Class. This is one of THOSE commands that doesn’t ask for an output, it just does it to your original data set.

ArcToolbox:

  • Data Management Tools > General > Delete Identical
  • Select your Feature Class
  • Choose the “Shape” column – nothing else.
  • Run the tool.

Good Luck!

 

Posted in Uncategorized | 2 Comments

Too Many Features?

I have always been a proponent of Function over Features.  What this means to me is that I would much prefer to have software that functions well – with minimal bugs – than one with lots of features that intermittently works.  This seems like a “duh” moment, but apparently a number of major software manufacturers don’t quite get it.  For example, a major GIS software producer (they-who-must-not-be-named) seems to consistently put forth new versions that have an increasing number of features – many of which work intermittently, and some not at all.  As an aside, I do like how their support web site ignores/ hides forum posts from past versions as if these problems have been fixed.  I now have to use Google to find the answers in the old forum and the work-around for bugs that have existed for the last 2 versions and x service packs.   Nevertheless, I believe that my life would be easier if I had a set of features that I could simply rely on, rather a suite of haphazard functionalities (not a word, but I live in Alaska).  I recently calculated that during production and geo-analytical work, I spend about 25% of my time trying to work-around known or new bugs in the software.  All though I selfishly appreciate this complexity as a form of job-insurance, I see the frustration in my clients daily.  Since they-who-must-not-be-named are a monopoly, there aren’t any viable alternatives for these people.  To the point, and what got me on this track to begin with, here’s an interesting article on another persons’ (somewhat ironically – Ray Ozzie) take on complexity.

http://ozzie.net/docs/dawn-of-a-new-day/

…But as the PC client and PC-based server have grown from their simple roots over the past 25 years, the PC-centric / server-centric model has accreted simply immense complexity.  This is a direct by-product of the PC’s success: how broad and diverse the PC’s ecosystem has become; how complex it’s become to manage the acquisition & lifecycle of our hardware, software, and data artifacts.  It’s undeniable that some form of this complexity is readily apparent to most all our customers:  your neighbors; any small business owner; the ‘tech’ head of household; enterprise IT.

Success begets product requirements.  And even when superhuman engineering and design talent is applied, there are limits to how much you can apply beautiful veneers before inherent complexity is destined to bleed through.

Complexity kills. Complexity sucks the life out of users, developers and IT.  Complexity makes products difficult to plan, build, test and use.  Complexity introduces security challenges.  Complexity causes administrator frustration.

And as time goes on and as software products mature – even with the best of intent – complexity is inescapable.

Indeed, many have pointed out that there’s a flip side to complexity:  in our industry, complexity of a successful product also tends to provide some assurance of its longevity.  Complex interdependencies and any product’s inherent ‘quirks’ will virtually guarantee that broadly adopted systems won’t simply vanish overnight.  And so long as a system is well-supported and continues to provide unique and material value to a customer, even many of the most complex and broadly maligned assets will hold their ground.  And why not?  They’re valuable.  They work.

But so long as customer or competitive requirements drive teams to build layers of new function on top of a complex core, ultimately a limit will be reached.  Fragility can grow to constrain agility.  Some deep architectural strengths can become irrelevant – or worse, can become hindrances.

Posted in General Stuff, Software Rants | Leave a comment

Compromise of GPS

It has recently been brought to may attention that there is a real and current threat to the use of GPS in the U.S. An article on the URISA website describes the attempted licensing of a segment of the radio spectrum adjacent to the GPS signals by a broadband company, LightSquared.  LightSquared is planning a network – based on 4G/LTE technology consisting of 40,000 cell towers across the U.S.  Recent tests by the FCC indicated that this technology will affect GPS signals.   Although LightSquared contends that they are pursuing technologies for filtering their signals, some GPS users will be affected.

You can find more information on this issue at www.saveourgps.org.

Posted in GPS, Hardware, Software, Technologies | Leave a comment

Hello world!

I was inspired to start this blog when, for not the first time, I found myself trying to accomplish a simple task and instead spending a great deal of time on debugging and developing workarounds.  At the end of the day, I could only describe my day as spent in “GIS Hell.”   Maybe someone will find solace or assistance in my notes – maybe not.  Anyhow it seems like a good way to vent.

Posted in General Stuff | Leave a comment