Archive for the ‘Uncategorized’ Category

Why the Platform Is Important

Thursday, September 17th, 2009

Sometimes we can miss how large marketplaces can be, and their importance to development new ecosystems and technologies. The iPhone app market gives a glimpse as to why a SaaS-based application platform is so important for future geospatial business growth.

While the iPhone article describes a consumer based platform (mobile phones) for applications, the concept for a geospatial application platform is similar. By providing a platform on which developers can “write their own visions” of products, more products are developed, tested, purchased, and discarded at a much higher frequency than previous enterprise development cycles. This increase in the velocity of the product development cycle will provide opportunities in the future beyond those previously seen in the traditional software business. It will also increase the risk of marginalization of current software packages.

Our mission has been to develop a means to bring platform technologies to the geospatial industry. We focused on content first, because most of the current value of geo-knowledge is “stored” in the content produced under professional services and consulting contracts. The geospatial content are also larger and has proprietary file issues that are not necessarily seen in the consumer web space, which add to the difficulties in providing a true application platform to the Spatial Data Infrastructure (SDI).

However, it became clear to us about 2 years ago that cracking the content index, search, customization, and delivery process required developing an application platform along with the content management platform. So we began the process of creating an application platform that is accessible through APIs, which we then used to build our content management platform. Furthermore,we sought a partnership with a vendor who could supply additional transforms and ETL functions (Safe Software), which we could expose via our SaaS offerings, to allow others to build their own applications. We have thus created a geospatial application platform that will allow others to rapidly create their own small, but very targeted applications. By providing this application platform at the same time as providing the content management and financial services, all on a scalable SaaS-based architecture, we are poised to create an ecosystem around developer-driven applications and content.

This application/content (de-)evolution from the traditional software vending models is happening all around us. It will come to the SDI, probably a little later than other consumer driven niches, but it is coming. We strive to be that platform that others use to make money, and in that process help change our world.

Switching From Ka-Map to Openlayers

Wednesday, November 12th, 2008

WeoGeo is continuously developing our scalable geo-content management technology.  One of the most “visible” recent changes is the switch from ka-Map to Openlayers for displaying our pre-cached image tiles for preview and customization.  The switch was driven by the need to enhance the performance and functionality of the site, as well as enhancing the ability of our developers to create a better product in the future.

Below are some of the benefits of our switch to Openlayers:

  • No more IFRAMEs = faster site loading, fewer HTTP requests, less memory usage (1 browser process instead of 4)
  • When zooming in and out, tiles from previous zoom-level are resized and will appear dithered, until new tiles load. This is an improvement over the old behavior, where zooming in would result in a blank canvas temporarily while the new zoom-level tiles loaded.
  • Rubber-band zoom – hold-down shift and draw a box around area of interest
  • Dataset selection is retained in the navigation maps grid when zooming in and out, as long as the selected dataset continues to appear in the result list.
  • Zooming in with the mouse wheel will keep the area under the mouse cursor at the same position, rather than zooming straight into the center.
  • The dataset map extents are limited to the bounds of the dataset.

We continue to focus on developing the best content library, hosting, and market place service for the mapping industry.  Stay tuned for more exciting things to come.

Trust Jack

Tuesday, October 7th, 2008

I am not sure how many people in our industry are paying attention to the meltdown of the global financial services industry, but I want to point out the following interview with Jack Dangermond:

In it, Jack describes that growth of our industry as well as his expectations of ESRI:

ESRI has been growing annually at about 10-15% worldwide for many years, and in 2008 the company is growing at a rate of 17%, said Dangermond, adding that this “is counter intuitive to the whole stock market and economic downturn.”

In addition, he gives some thought to the differences between money capital and resource capital:

In terms of the global financial turmoil, Dangermond said “people today are very nervous about what is happening on Wall Street and what I am more concerned about is ecological sustainability and global warming issues on the planet, because they are not something that you can go to the bank and borrow more money from. The real sustainability issue and the real economic foundation is nature’s capital, it is not artificial money capital.”

Now, I’ll be the first to admit that I don’t see eye-to-eye with Jack on a lot of things. Money and intellectual capital are important for transitioning goods and services towards a more sustainable path. But for the most part, I think he is dead-on about the opportunities for our industry and the importance of our field.

Hang in there people, we’re in for a wild ride for the next 18-24 months. Keep your heads down, work hard, and keep pushing the envelope, and we will change the world.

Jack Dangermond, wikipedia
http://en.wikipedia.org/wiki/Jack_Dangermond

Who Owns Your Geo-Knowledge?

Monday, July 21st, 2008

I read with interest today that the B.C. Government’s deal with Google to turn over its entire geographic database to Google (see also the AnyThing Geo Blog). From the Vancouver Sun -

On Friday, Agriculture and Lands Minister Stan Hagen announced GeoBC, a government organization, will provide 24/7 access to the province’s geographic database in partnership with Google. This information will be available online at geobc.gov.bc.ca and from Google Earth.

This is a great opportunity for the government to disseminate its geo-content through another portal. The deal allows the BC government to follow its mission to best serve the public that originally paid for the geo-content.

However, if you review what is happening in Hollywood with respect to writers and actors demands for a greater share of the digital reviews from marketing their products through non-traditional portals, i.e. the Internet, I believe that there may be storm clouds on the horizons for geo-content producers.

For Google, it is a great way to get content with which to build the LBS business that will eventually sell advertising. Yet in its traditional business, Google pays referral fees to content providers for other types of content, such as blogs, using Adsense. It is unknown whether they are paying anything to the BC government, but the geo-content creators will receive nothing.

One could argue that the geo-content creators have already been paid. But this is the same argument used by the studios in the writers strike. I think that this may be a future issue for our field.

Aerials Express Signs Up for WeoGeo Market

Wednesday, January 30th, 2008

How do you make a geospatial exchange a reality? You find great content providers to bring their wares to the market. Aerials Express (AEX) is one of those great content providers. With 420,000 square miles of high resolution aerial imagery over major metropolitan areas in the US (see map below), AEX brings base map content to “prime-the-pump” in the derivative product marketplace.

Christopher Warren and Bill Landis at AEX have been great. Their listings of AEX products address a big niche in our industry. High resolution imagery that can be physically acquired and manipulated with an explicit license to resell derivative works. Bill’s quote from the Press Release -

WeoGeo is an excellent opportunity for our company, said Bill Landis, President of Aerials Express. We are looking to WeoGeo’s advanced technology and unique distribution model to enhance the availability of our products into a wider range of GIS related markets.

It says a lot about the potential of an exchange-based market for our industry.

We will do our absolute best to make the market technology easy to use for search, discovery, and product acquisition. Its success will increase productivity and margins for all of its participants. Today, we mark its beginning.

Profiting From Collective Intelligence

Wednesday, October 10th, 2007

I have had a number of questions from our private beta Providers that basically ask, “What maps should I be making?” To be honest, I wish I knew. In reality, WeoGeo Market was established to answer this very question.

We set up WeoGeo to lower the risks of creating and selling mapping products (most importantly by reducing marketing and transaction costs). We believe that by lowering the risk of creating and selling geo-content, more products could be created at lower prices. By combining more products at lower prices with a greater ability to find and customize those products, Users of those products would be more apt to purchase more geo-content. The overall goal is to create a truly functioning marketplace for geo-content. The end result would be a collective intelligence expressed through the market that would help all of us focus on making the most valuable geospatial products.

Answering the question of what product to create is one of the hardest parts of running FERI’s operations. While FERI is a research and development organization, we still had to perform the basic sales and marketing efforts of finding paying customers to support our development of value-added mapping products. It is a very time consuming and difficult process, requiring a lot of telephone calls and a lot of travel to search out programs that would value our imaging and mapping efforts. Such is the nature of sales and marketing, and every good salesman would tell you that is just the way you have to generate business.

However, as a scientist I want to focus on the generation of new mapping products. While I could (and still do) focus on sales and marketing, my real interest is in generating new mapping products that could help people make decisions with their resources or help save lives. With the hyperspectral imagery, we could develop maps focused on a variety of topics. These maps could range from Harmful Algal Blooms (HABs or more commonly called red tides) to Submerged Aquatic Vegetation (SAV) to detecting probable locations of Improvised Explosive Devices (IEDs). Yet, finding sufficient demand for these products to overcome the high initial production cost of creating these products is difficult. (I have a whole other story on the IEDs and how the DoD does business with contractors and appropriation earmarks that I’ll save for another time.)

Over the years, we have watched with great interest how the internet has impacted other businesses. One of the most interesting impacts that we have seen is the rise of shared intelligence from the accumulation of individual choices. For example, search engines have used the individual linkages of web page creators to develop a collective intelligence estimate of the most likely desired result for a search term (and a new industry of search engine optimization). In particular, we were fascinated by eBay’s ability to enable millions of people to develop larger markets for their niche products.

By establishing a functioning marketplace for these niche goods, eBay created liquidity and demand for products that previously had limited marketability. In the process of creating a market whose niches could be efficiently filled, they also provided opportunities for entrepreneurs to develop new markets. In effect, eBay created a platform that enabled individuals to make choices, create products, and satisfy the needs of others, which in turn created a positive feedback mechanism for everyone who participated. This led to the creation of whole businesses that did not exist prior to eBay, and the rise of the valuation of goods that previously had limited market enetration, and thus, underdetermined recognized value.

The increased liquidity of products and the collective actions of many individuals led to a self-sustaining marketplace that enriches all of the participants. eBay is a lesson in economic theory, and gives truth to the concept that “a rising tide lifts all boats.”

So what does this have to do with answering the question from our Providers about which maps to produce? The answer to that question is that I am not sure, but I can make sure that the Provider’s risk is low enough for them to make some reasonable choices, and to give them the agility to respond to market demands. Through this process, I believe that our collective intelligence will point Providers in the most profitable direction.

This marketplace will give those with the skills and those with the content the ability to connect as never before possible. The new network of connections will lead to the creation of new geo-content that will enhance and enrich the lives of our community. And our community will profit from it because we will know which maps to make.

KML Listing of Your Maps in ArcGIS Explorer, Google Maps, Google Earth, and NASA World Wind

Wednesday, October 3rd, 2007

With the Open Geospatial Consortium (OGC) planning adoption of KML as a standard, we’ve focused our efforts in its support on varied platforms. KML’s previous proprietary nature was a cause for concern as Raj Singh aptly describes:

And one crucial point that I think a lot of people miss is the legal intellectual property aspect. Bringing KML into OGC isn’t just about what features end up in that XML format. It’s just as much about making sure the format is royalty-free to use forever.

We use KML as an additional means to help our Users (map consumers) and Providers (map sellers) use the Market. A reduced resolution KML is created for free whenever a dataset is listed by the Provider.

For Providers, a reduced resolution KML button on Panel 4 offers a link to their listing’s KML file. An example of this feature for FERI’s hyperspectral map listing can been seen in the red circle on Figure 1. The link in the red circle provides access to a KML file, which can be used by the Provider as another method to market their map listing through other mapping programs. These links (the one to the listing or the one to the listing’s KML) or the reduced KML itself can be used in any of the provider’s marketing material or blog posts.


Figure 1. WeoGeo Market listing for FERI’s St. Joseph Bay hyperspectral mapping product (click on the image to go the Market listing). The red circle in the bottom left hand corner links to this data product’s reduced resolution KML. The blue circle on the bottom right of Panel 5 is for high resolutions KML products, which are fully tiled and regionized products that the Provider may offer for sale (to be covered in a future post)
.

For the User, this feature helps them decide whether this map is appropriate for their needs. By viewing the KML in their favorite map viewer, the User can quickly see if this listing intersects with their area of interest or other mapping products. As an example of this feature, here is the KML from the listing in Figure 1 seen in ArcGIS Explorer, World Wind, Google Maps, and Google Earth.


Figure 2. KML listing of FERI’s St. Joseph Bay hyperspectral mapping product offering on WeoGeo Market as seen in ArcGIS Explore v 9.2, build 410. Currently, the KML needs to be saved as a file to your local machine from the link and imported into Explorer. In the balloon is a link directly back to the specific WeoGeo Market listing.


Figure 3. KML listing of FERI’s St. Joseph Bay hyperspectral mapping product offering on WeoGeo Market as seen in Google Maps. In the balloon is a link directly back to the specific WeoGeo Market listing.


Figure 4. KML listing of FERI’s St. Joseph Bay hyperspectral mapping product offering on WeoGeo Market as seen in Google Earth. In the balloon is a link directly back to the specific WeoGeo Market listing.


Figure 5. KML listing of FERI’s St. Joseph Bay hyperspectral mapping product offering on WeoGeo Market as seen in NASA World Wind v 1.4. The KML needs to be saved as a file to your local machine from the link and imported into World Wind.

Follow-Up to Direction Magazine’s Podcast on WeoGeo

Tuesday, October 2nd, 2007

Adena Schutzberg did a podcast with me last week on the business model for WeoGeo. It was my first podcast and I hope that I made sense to people (I welcome comments and/or critiques in the comments section here). I would like to thank Adena for giving us the opportunity to tell our story.

However, I am not sure I was as clear as I could have been about our history and the importance that history in the development of WeoGeo. I could not quite put my finger on what was missing until after the AWS StartUp Event – Boston (see here as well for my comments) when someone asked how many man-years of effort went into developing the site.

My first response was to take the number of years that FERI was in operation times the number of people involved at FERI. Kind of silly, I know. But when I think of why we built WeoGeo, this response seems relevant. Their response, of course, was, “no really, how much technical development time?” I understood the question; the person was trying to ascertain how difficult it would be to recreate what we are doing.

Our technical development on this project did start back around 2001 with a project called Hyperspectral Data Repository On-line (HyDRO). This was our first distribution system, developed to help alleviate the problems associated in delivering HSI data to our customers. This concept and technology eventually evolved into the WeoGeo Server (see post here as well). Between 2001 and 2005 we had 4 PhDs and masters-trained personal spending a portion of their time on HyDRO because it was a critical element of our research programs. In the last couple of years, we increased the number of people working on WeoGeo Market/Server, to >12 currently if you include outside contractors. For the most part, they are highly trained GIS and MIS/CIS/CS personnel.

The technology is hot, no question about it. I am amazed on a daily basis what our group of people has developed for mapping on both commodity computers and utility computing systems. Yet, here is the rub to this type of man-years calculation. I really believe that the reasons for WeoGeo, and its associated development time, stem from our history at FERI, which makes such calculations difficult. The “technical development time” is not just time spent coding; it includes the needs assessment and the development of the system architecture to address critical problems and/or pain. What we have developed at WeoGeo is a direct function of two critical needs of our operations as a research and imagery services organization.

These two critical needs were (and still are):
1) Delivery of our survey grade, high volume mapping content;
2) Finding and acquiring other survey grade mapping content to fuse with ours to create value-added geocontent for our clients.

WeoGeo was built to solve these two critical problems (there are others, but not nearly as critical to our organization as these). If you have never been faced with these problems, then you might not appreciate the depth of the solutions we have built to service these needs (and its potential). But if you have, then you have felt our pain – and I hope value our solution.

Image Fusion and Sharpening With Multi and Hyperspectral Data

Thursday, September 20th, 2007

The panchromatic limitations of WorldView-1, recently launched by Digital Globe, have brought a few posts (e.g. free geography tools and the confused life) on the fusion of high spatial resolution panchromatic imagery (PAN) with lower spatial resolution multispectral imagery (MSI). I thought I would briefly comment on image fusion because over the years it has become easier to accomplish, but the results or limitation of the fused product may be difficult to understand.

There are many ways to accomplish pan-sharpening including band substitution, color space transformation and substitution, and Principle Component Substitution (Jensen,2005). As mentioned on the confused life, temporal decorrelations introduce artifacts into a fused, or PAN-sharpened image. However there are other artifacts that can be equally important if one is trying to create a quantitative product for classification mapping or target detection.

The inherent difficulty with all of the PAN sharpening methods is that they are fundamentally based on the technical and environmental conditions under which the PAN imagery was collected. Since it is difficult, if not impossible, to accurately correct for illumination and atmospheric conditions in PAN sharpened imagery (subject for a much longer post), the PAN-sharpened images may be limited to classification and detection within a scene. Inter-scene comparisons (i.e. change detection between scenes or cross scene classifications) using spectral properties require the aforementioned corrections. In addition, when the instantaneous field of view (IFOV) of the PAN and/or MSI sensors are too large, spectral and illumination changes will be present at the edges of the image, making even within scene classifications difficult. Because of these issues, PAN-sharpened multispectral images are frequently used to identify features based on relative color differences within an image, rather than target identification or environmental characterization based on a spectral signature itself.

Figure 1. The fusion of high spatial resolution MSI (left figure) with lower spatial resolution HSI (middle figure) into a high spatial resolution, high spectral resolution image (right image). The bottom row of images represents the spectral plots at the pixel located at the center of the red cross hairs in the images directly above them.

We have done some work in this area, mainly focused on sharpening hyperspectral imagery (HSI) with multispectral imagery (MSI). Figure 1 shows the results of some of our efforts. The left image is a high resolution MSI from an Applanix DSS. Underneath it is the digital value of the RGB channel of the image. The middle image is the lower spatial resolution HSI; and underneath it is the full spectrum resolution of the HSI vector (~3 nm resolution). By fusing these two images together (right image), we were able to create a high spatial resolution sharpened HSI image whose spectral vector matched reasonably well with the spectral vector from the original HSI image. The use of atmospheric- and illumination-corrected HSI imagery means that we could make classification comparisons or target detections using these spectra much more robustly across scenes in time and space.

When making fused, or derivative, mapping products the value of the map is critically determined by the base mapping material and the skill of the map producer. Understanding the limitations of the base mapping material as well as the fusion techniques themselves is a critical determinate in the value of a derivative mapping product.

References
Jensen, John J., Introductory Digital Image Processing: A Remote Sensing Perspective. Prentice-Hall, Englewood Cliffs, NJ, 2005, 526 pp.

How Do You Connect “Islands of Information”?

Tuesday, September 11th, 2007

The worldwide spatial information management industry has been estimated at ~$50 billion. While large, the industry is dominated by specialization and niche practices that have reduced the flow of spatial information between location-aware enterprises. This reduction in information flow decreases efficiency and productivity within enterprises, and between industries.

Let us examine the different vertical markets that make up the spatial information industry, including urban planning, emergency response, real estate, natural resource management, environmental protection, agriculture, asset management, construction, advertising, etc. They all use slightly different tactics to acquire their spatial awareness or geospatial intelligence (Figure 1; this figure and the next are from a 2007 Where 2.0 presentation. If you are interested in the full presentation let me know.). However, all of these industries have very similar needs in that they require high quality maps to make fundamental (insert your favorite term here, e.g. business, asset, resource, targeting, etc.) decisions.

Figure 1. Vertical silos in the spatial information business keep the markets small and separated.

If we can break down these vertical silos, such that the maps in one niche were used as raw material into the next niche, we can re-order our geospatial markets to look like Figure 2. Here, the silos become building blocks for higher valued information products, which in turn are used as base products for higher valued geo-enabled processes. These building blocks now increase business process efficiency and productivity for the spatially-aware enterprise. As any process manager will tell you, increasing efficiency and productivity is good, really good, because it means you can do more for less.

Figure 2. Silos are changed into building blocks for higher valued industries, increasing efficiency of productivity and resource management.

A recent article from Geoff Zeiss (who was building upon a 2004 article by Paul Teicholz) used the construction industry as an example of the impact of information silos. He first points out the size of the construction industry, worldwide = $2.3 trillion, US = $1.2 trillion. That’s trillion with a T.

Paul’s article examines a decline in construction productivity, during a period when all other industries were looking at increases in productivity (Figure 3). Paul points to a lack of IT integration and R&D by the building industry as a reason for this real fall in productivity, while all other non-farm industries appear to have used IT to become more productive. Geoff goes farther (and I tend to agree with him) that part of the problem relates to the ‘Islands of Information’ that are created, and not shared, by the various disciplines involved with the construction industry:

Disciplines such as architecture, structural engineering, construction, civil engineering, and GIS are classic information silos. Each maintains its own information island comprised of design applications and data. This has created a nightmare for operations and maintenance, emergency planners and responders, urban planners, and others who require seamless access to urban terrain including building interiors and exteriors, roads and highways, and above ground and underground utilities. The biggest challenge is not typically data, because the data that would help these folks already exists because much of (sic) it is created when buildings and infrastructure were designed. The biggest challenge is that islands of information and technology make it difficult to integrate existing data in a seamless view.


Figure 3. Labor productivity declines 1964-2003. (from ACEbytes Viewpoint #4)

WeoGeo was started to specifically address the creating, sharing, and marketing of geospatial content that will help increase the productivity of spatially-aware industries. We have built an easy to use interface and system to rapidly list, host, discover, customize, and deliver value added geo-intelligence in a way that generates revenue for content providers, which will be affordable for content users. We are using a classic exchange mechanism to create a neomarket to “remake” the silos into “connections” between the islands of geospatial information (I know I am mixing metaphors, but I couldn’t help it. Sorry.)

Does it matter? Are there enough inefficiencies to be found that will translate into dollars to make a difference? Here is another quote from Geoff’s piece:

Several years ago the National Institute of Standards and Technology (NIST) commissioned a study on Interoperability to attempt to quantify the efficiency losses in the U.S. capital facilities industry… NIST estimated that in 2002 poor interoperability cost the US capital facilities industry $15.8 billion.

That leaves some room for improvement in efficiency. And this is just one spatially-aware industry. An increase in productivity in these industries will create a more efficient use of (natural) resources, which over time creates a positive feedback into the quality of operations (and life) for all those using planetary resources.