GeoTools

OSGeo

Showing posts with label foss4g. Show all posts
Showing posts with label foss4g. Show all posts

Thursday, April 20, 2017

GeoTools 16.3 Released

The GeoTools team is pleased to announce the release of GeoTools 16.3:
This release is also available from our maven repository.

This release is made in conjunction with GeoServer 2.10.3.

GeoTools 16.3 is the first maintenance release of the 16.x series and 17.0 is now recommended for all new projects. In future this branch will only receive bug fixes but no new features will be added.


The GeoTools team is grateful for Astun Technology for sponsoring this release.

Features and Improvements

Features & Improvements

  • gs:PointStacker now has an attribute that holds the bounding box of the clustered features 
  • TransparencyFill process has been added to the unsupported/process-raster module 
  • GeoTools now uses Java 7 Base64 Encoder / Decoders throughout. 

Bug

  • Shapefile attribute (DBF) DbaseFileReader reads numeric empty values as zero 
  • Mollweide projection misses parameter
  • PostGIS sql dialect fails to encode 3D bbox filters
  • GridCoveargeRenderer.renderImage may throw a NPE
  • ProjectionHandler.getQueryEnvelopes can return invalid envelopes for transverse mercator
  • Geometries not created when using WFS data store 2.0.0
  • Band selection via request param and RBG expansion are incompatible
  • ImageWorker should invalidate statistics after a Crop
  • Shapefile dumper throws a NPE on NULL geometry values
  • Crop and rescale to bytes fail to propagate nodata values
  • Incorrect validation when parsing XML schema element declaration with ref attribute
And more! For more information please see the release notes (16.316.2 | 16.1 | 16.0 | 16-RC1 | M0 | beta).

Wednesday, September 9, 2015

GeoTools at FOSS4G 2015

Are you heading to FOSS4G 2015 next week? As a library GeoTools tends to keep a pretty low profile - still we have a couple activities for you to attend.
Workshop:
  • GeoTools DataStore Workshop (WS03 14-Sep)
    Ian Turton and Jody Garnett are running an intermediate offering an inside view of how the vector data access subsystem works through the creation of a custom DataStore.
Presentations:
  • Raster Data In GeoServer and GeoTools (18-Sep 16.00)
    Andrea Aime explores the developments performed during last year as far as raster data support in GeoTools and GeoServer.
Bird-of-Feather:
  • GeoServer GeoTools BOF (Wiki 16-Sep 17:40 Room 10)
    Bird-of-a-feather sessions at FOSS4G range across user-group style collaboration, technical questions with the development team, exploring project plans, community challenges and out reach.
Code-Sprint:
  • GeoServer GeoTools Code Sprint (Wiki 19-Sep)
    Hands on development with the GeoTools team - what would you like to work on? Add your name to the wiki and let us know.

Sunday, September 14, 2014

GeoTools at FOSS4G 2014

Thanks to the local organising committee, volunteers, all the sponsors and over 870 attendees we had a wonderful time at foss4g 2014 in Portland.

GeoTools DataStore Workshop

On the GeoTools front we started off the week with a workshop I have been looking forward to running for some years now ... creating your own custom DataStore. This was an exciting workshop as it relied on participants bringing their own device (and in this context their own IDE).
This workshop is available for general use now:


A big thanks to Eva Shon, Ian Turton for prep assistance on Monday. Thanks to both Ian Turton and Tom Kunicki for holding down the fort, helping attendees with maven and keeping the workshop entertaining. We would of course like to thank our employers Boundless, Envitia, and WSI (a division of The Weather Company).
Demo Time at DataStore Workshop
It was great to hear from teams throughout the week that are already working on porting their custom data access work from AbstractDataStore to ContentDataStore. Everyone else ... you are put on notice - AbstractDataStore has had its time in the sun and it is time to move on.

GeoServer, GeoTools and Friends 2014

GeoTools also enjoyed a bit of air time in GeoServer, GeoTools and Friends 2014.


Thanks to Andrea, Jody and Justin for making the above presentation available.

Java Code Sprint

Finally we enjoyed a one and a half day code sprint, with a wide range of projects. It was a great chance to catch up with teams making great use of GeoTools (and fix a few issues). Thanks to WhereCampPDX and  Boundless for providing creative space.

Monday, October 3, 2011

GeoTools FOSS4G 2011

GeoTools had a great showing at the recent FOSS4G Conference (Free and Open Source Software for Geospatial) which was held in Denver last month. Presentations at the conference highlighted how the hard work of the GeoTools developers is paying off in terms of the wide adoption of the library, and its use in some amazing applications.

There were a number of talks directly on GeoTools this year:

GeoServer as always provides an excellent example of GeoTools in action:

These presentations are a great way to see what is possible with GeoTools. Often it is easier to understand the capabilities of the library by seeing it in use, and both the State of GeoServer and Advanced cartographic map rendering presentations are excellent examples of this.

A special mention to GeoScript which is building a bridge between GeoTools functionality and a range of scripting languages, with the emphasis on providing a concise and simple API:

Geomajas had a strong showing this year with several presentations plus a hands-on workshop:

We are hoping to attract more direct participation of Geomajas developers in the GeoTools project (for now we just have a welcome page).

Did I miss you project in this roll call? Contribute a welcome page to the GeoTools User Guide in order to be included in promotional activities!

GeoTools Codesprint

Finally a big thanks to those taking part in the GeoTools code sprint!
  • Looked into why sorting is turned off for MemoryDataStore!
  • Put together a Process Tutorial (OctagonalEnvelope in 5 lines!)
  • A couple great volunteers (shown below) updated the Eclipse Quickstart to work with the included copy of Maven
  • Looked into Neo4j - but got stuck on AGPL license (grrr!)

Tuesday, September 21, 2010

GeoSpatial for Java Workbooks available

It has now been a couple of weeks since foss4g and life is returning to normal. Thanks to everyone who contributed to a great experience. Part of that great experience was the workshop program; facilities were excellent; that staff helpful and due to a bit of scheduling fun the GeoSpatial for Java workshop was packed.

Justin and Jody were on hand for an intensive hands-on workshop "GeoSpatial for Java". This workshop offered an introduction to GIS concepts for Java developers - which is a really nice introduction since you can try out ideas and see how they work using running code.

The workshop materials have been published here:

These workbooks are detailed step by step instructions written in a "code first" style. This allows you to carefully go through the steps required to produce runnable code. If you have any questions about the concepts or ideas covered you can continue reading for the background information.

Geospatial for Java
View more presentations from jgarnett.

This tutorial information has been gathered up in the "sphinx" documentation system; and pulls directly from Java source code examples that are built as part of our GeoTools nightly build.

Thanks to Justin for his help in setting up the sphinx nightly build; and if anyone is good at sphinx "rst2pdf" I would love to get this content out in printable form.

Saturday, October 6, 2007

GeoTools was really well represented at this years Free and Open Source Geospatial conference. One of the advantages of being a library is that we can really be everywhere. The downside is that even if you attended the conference (wasn't it great!) you could not of managed to catch all that we had going on.

I am going to start with just a list of links and then try and ask the authors for a couple of comments on how their lab / presentation / demo went. I made a point of talking to people in the evenings and asking about their favourite presentations - where possible I have shared their comments.

Workshops and Labs

GIS for Web Developers

Scott Davis is a long time GeoServer power user, and generally great at abusing our software stack and sending good bug reports. Apparently the practise has warmed him up for writing full length books. As I understand it Scott used and abused a harmless GeoServer war in wonderful ways cumulating in a nice AJAX front end.
Scott's talks are always well received, now if only he cleaned up after his Lab things would of went better for me :-) His class configured GeoServer to the point where it was not stable for my GeoTools lab later in the week.

Introduction to Geospatial Collaboration using GeoServer

These guys had a great time - I ran into The Open Open Planning Project crew after words in the pub and they were all smiles. The room was at capacity with 80 people.
A full complement of GeoServer developers showed to provide lots of personal attention. Thanks to Chris Holmes, Justin, Saul Faber, Scott Davis and Simone.

An Introduction to the uDig Open Source Desktop

This lab was great. I talked for a total of a two minuets before letting people have at it. We went through a wide range of functionality and were sure to try out as much of the open source software stack as we could get out hands on (everything from PostGIS to MapBuilder).
A range of power users and developers showed up to provide that all important personal touch. The room was completely full (with a couple of mac user sitting on the floor at the back). Everyone went home happy.
Thanks to Jody, Jesse, Cory, Andrea, Silvia and Brock for making our dreams a reality.

How to Cope with GeoSpatial - The Pragmatic Intro for the Java Developers

This was the only hard-core hands on programming lab at the conference this year. Thanks to everyone who attended! GeoTools was used to access a Web Map Server, generate a Shape file, hack away at PostGIS (using Common Query Language and Filter 1.0). Students that finished early got a chance to visualization with Images and Shapefiles.
One user commented that this was what a lab should be - not a lot of talking and all the instructions printed out. Don't tell the uDig crew but we used QGis to check that shapefiles were generated correctly. One difficulty we encountered was the local install of GeoServer had been messed up by a previous Lab.
Thanks to Jody, Martin, Brock an Melisa for pulling this one together. Special thanks to Andrea and Jesse for the code review.

Opening Plenary Session

Geoff Zeiss provided an interesting speaker; who served to underline the need to talk standards as part of a larger motion of pushing GIS into everything. Apparently some of the building standards have been tricked into adopting GML and actually placing their buildings somewhere in the world. Some interesting work ahead of us I suspect before GIS dissolves into the general grab bag of IT constructs and finally becomes just another domain. It was interested that he felt validated in the decision to go open source based on "the community" providing FDO with access to a few more formats. It is important to recognize what value people are expecting out of their open source experience; sometimes it is not what you would expect.
Tyler Mitchell was on hand to give nice little talk about community complete with interesting expanding circles that showed the connectedness of all things. Long winters in Canada make for great diagrams - he has a much better expression of what was going on here Touchdown! FOSS4G 2007 A Resounding Success
Peter Rushforth was in town representing the much respected GeoConnection program. GeoConnection has been an important source of inspiration and funding for many projects that feed off of (and into) GeoTools development. He appeared a little bit disjointed from the surroundings, one of the major themes was the Canadian Data Infrastructure which is a little bit of a tough sell to an international conference focused on software. I sometimes get the impression that Canada's funding of open source geospatial software is a bit of an accident on the way to cold hard data deliverables.
Still warm fussy software makes you feel good and GeoConnection has been the motivator for more than its fair share.

Lightning Talks

James Macgill (our honoured founder - yes he is from England so I am jolly well going to spell honoured with a "u") was on hand to talk about the extravaganza that was the OSGeo summer of code projects.
Raj Singh made use of the lightning talks to talk about how OSGeo and standards can play well together, and how OGC is sure to include an open source reference implementation for new standards as they come out. It was nice that Raj recognized the difficulties we have in cooperating around standards (even just access to them is difficult). It sounds like the combintation of OSGeo to talk for us and personal OGC membership will help address many of these concerns - here is hoping.
Aside: Schuyer Earle did his usual amazing attention span-of-a-gnat-on-speed how-long-can-you-watch-him-click-through-slides-before-you-blink and lose-context-for-the-rest-of-his-talk power hour tour of off the wall subject material. This year it was about breaking down the subject material of the conference and trying to make sense of it using only the POWER OF STATISTICS. He presented a series of really interesting scatter plots showing how the presentations and labs split up on a number of metrics. It was really very cool to see Java so well represented and recognize that GeoTools was powering a lot of the show. What a difference from two short years ago.

Presentations

A Survey of Open Source GIS

Paul Ramsey's perennial survey talk is always a hit - and every year you need to see it again. It is really with downloading the pdf from the above page - but you will have to image Paul's wry wit for yourself. In talking to people afterwords many listed this talk as the cornerstone of their FOSS4G experience; based on the survey they planned out what presentations and projects to hunt down for the remaining three days. You can always tell who attended this talk as they started categorized everything in terms of the "Java" tribe or the "C" tribe.

WMS Performance: Mapserver vs. Geoserver

Justin assures me this was supposed to be titled "MapServer and GeoServer" but apparently "vs" makes for better attendance. Have a look at the attached pdf - the numbers (and everyones hard work) really speak for themselves.
The real take home lesson here is to spend some time configuring both application if performance is critical to you. Actually the real take home lesson is to have a look on our support page and hire all us smart developers to make the software faster!
Thanks to Justin and Brock for putting on such a good show. Thanks to Andrea for making GeoServer king this year

uDig Case Studies

I had a sneak peek at this talk and it is amazing the kind of diverse applications uDig has morphed into. The combination of eclipse rich client platform and the ability to "re brand" has resulted in a list of very targeted application. I wonder if this ability is the secret to avoiding the Jump fork explosion? 
Thanks to Jesse and Paul for rounding up all the contents; as well as the udig-devel list for providing the raw - enthusiasm- material.

JGrass and Udig, chronicles of a lovestory

Andrea Antonello is a funny guy; did that come through in his presentation? Update this wiki and tell me what happened!

An integrated client for Web Processing Services - Upgrading uDig with Processing power

I had a look at this work as it was under development (thanks for the uDig patch guys!). How did their presentation work out?

GeoServer, past, present and future

The Open Planning Project triumphs again - this time at the hands of their Lead Developer (when did this happen Andrea?).
Thanks to Andrea and Justin for tag teaming this presentation, great work guys.

GeoServer and the GeoWeb: KML, GeoRSS, TileCaching and SuperOverlays

As far as I know this is the only presentation to get interrupted by a round of applause - for the GeoServer/Google Earth time demo (which is admittedly really cool).

Secrets of the JTS Topology Suite

Apparently this presentation resulted in one of the most memorable quotes: "This talk is not about fluffy geo web services, it is about the serious stuff - Geometry". Everyone thought this was really funny; and were trying to capture the exact tone of voice at the pub afterwords.
Apparently the talk was great; but no match for Martin's wit.

IBM DB2 Express-C: A Free Database for Open Source Spatial and XML Development

David Adler is a long time GeoTools committer. He was here as part of a team to announce the free version of DB2 Spatial. Our man on the street, Martin Davis, was there in hopes of seeing source code ( Free is not the same as Open Source). The good news for us is (finally!) the ability to ship DB2 jdbc drivers so GeoTools can work out of the box with DB2 Spatial.
Thanks to David Adler and the DB2 team for the great talk, and supporting GeoTools for many years.

Using Open Source to analyze Canada's National Forest Inventory

GeoTools was used as part of this work - anyone attend the talk?

A New Geospatial Enterprise Platform Built on Open Standards and Open Source

Another win for GeoTools. Thanks to Belay for making this happen.

Next generation of raster support for the GeoTools-GeoServer stack.

You may know Simone by reputation. You may known Simone is really tall. What you do not know is how fast he can talk - this really felt like a 20 min lightning talk covering all things raster! It was telling that this room filled up with the hard core GeoTools developers as we tried to understand what Simone has done to make raster access so darn fast.
You will really have to read the pdf; there was a lot of content packed into those 20 mins. A GDAL bridge, speed, nD coverage, some more speed, and so on...
There were a couple of great quotes - at one point Chris Holmes asked "How did you figure it out?" with respect to JAI performance. The answer as always is "I read the source code". The good news is that Simone has been collaborating with others on the nD coverage work, and that he has a much closer relationship with the Java Advanced Imaging Team now - so his patches will take less time to fold into the mix.

Managing WMS and WCS multidimensional NetCDF Datasets with Geoserver

This was a really impressive talk giving a taste of what is to come. If Simone went really fast, the combination of Martin Desruisseaux and Mickael Treguer took their time and showed us how the parts fit together. As I understand it they have taken on the enormous task of 4D grid coveages (x,y, height and time!) with a killer combo of PostGIS and the file system. It looks like they took great pains to keep as much as they could at the AffineTransform and integer arithmetic level.
The best part was their demo showing how fast the results were and how much data they had access to.
Be sure to check out the pdf for some nice diagrams; and bother them to put their demo on up on the web. Thanks to Martin and Mickael for making this one happen.

Heavy Traffic: How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services

Here is a nice end user story about using all the part of the open source puzzle to handle a very impressive volume five terabytes of data. GeoServer is used for the WFS part of the equation, have a look and see how it is done.

Feature caching in GeoTools and uDig

Another Summer of Code project - did anyone catch the presentation?

Coordinate System Transformations in Geotools and uDig - Contribution of Google Summer of Code 2006 and 2007

Jan Jezek has been responsible for two Summer of Code projects; this year he focused on defining ad-hoc transformations. Anyone catch the presentation?

What's Going On Out There?: Using GeoServer for Analysis of Spatio-Temporal Environmental Data

Thanks to Tyler Erickson for putting this one together.

Geoserver and Open Standards: A Success Story

Saul Farber is a long time contributor and responsible for all our ArcSDE gooey goodness. His talk was aimed a bit at the business crowd and I head back some positive feedback from those attending. He told me he may change the focus a bit next time - but from all accounts this talk went very well.
Thanks to Saul Farber for making this (and so much more) happen.

Bird of a Feather Session

New Feature Model

We had a really interesting "BOF" session; initially with the mandate of figuring out the details for our upcoming cross project code sprint (GeoServer, GeoTools and uDig are moving to a standard Feature interface based on ISO19109).

Real Live Users

However when actual users showed up we quickly expanded our focus and had a good talk about what is needed (documentation!), how important is api stability (documentation!) and everyones broader experience (needs documentation!). I must thank everyone for their input on this topic - I will double back with my notes in a couple of days.
We had an interesting discussion about where patches go to die. Apparently some patches for the unsupported Oracle datastore have just stayed attached to their bug report. We talked about the need for an oracle module maintainer, and the difficulty of producing open source software against proprietary technology.
Of interest was the later arrival of gvSig developers and their difficulties in working with us. The combination of a difference in license (they are GPL and GeoTools is LGPL) and a language barrier results in a lot of forked code. It was fascinating to learn their large developer base, user interface testing department, and the availability of patched up GeoTools datastores.

Value of GeoAPI

We had a couple more interesting questions - the value of GeoAPI. In marked contrast the the keynotes standards are often viewed as a barrier to communication in an open source project. I have always thought that packaging up standards in nice friendly Java interfaces was the way to communicate at this level, but perhaps this is only an option when their is funding on the table.

Value of OSGeo

The final question was geared toward the value of OSGeo as a foundation. Here are some notes on the value of OSGeo:
  • GeoTools Developers - guidance with the few legal issues raised (how to we write a contributor agreement etc...)
  • GeoTools Users - documentation! While we could approach OSGeo for funding I would feel uncomfortable accepting money until we are through graduation.
  • GeoServer developers - contacts with other projects; in particular the #osgeo channel is well received
  • gvSig Developers - brand recognition

Demo Theatre

The Demo Theatre was very well received; and for me at least it was a great way to see what projects were while basking in the warm glow of caffine and/or lunch. There were a few standout presentations (route finder, open street maps and gvSig did really well). Most of the usual suspects were much too busy doing presentations - so this stage ended up being a good view of the exhibitors and interesting little projects.

uDig Demo

Jesse did a great job of showing off the capabilities of uDig. It was noted that uDig is going for record of 12 release candidates (edging out the previous winner GeoServer). All is forgiven as uDig makes for a great show of what is possible with the open source software stack.
In fact it was so good we had Jesse fill in for a dropped presentation; and then repeat again as we waited for Safe Software to get in the game.

Summer of Code

We had many of our students show up for the Google Summer of Code demonstrations. Thanks to Hans (sorry I could not be there buddy it conflicted with my lab). Jans had a pretty slick warping transform thing going on.

JTS Topology Suite

Martin Davis kindly gave a demo of basic Geometry operations - using JUMP. His testing app for JTS was untested on Java 5 resulting quick change of venue. While it may not sound like much; JTS is the foundation of almost all we do here - and a lot of people really understood what was going on when they coudld see spatial relationships naked on a projector (rather than dressed up with fancy styles in the middle of a web application).

Closing Plenary

Next year FOSS4G 2008 will be in South Africa - in Capetown. A few underhanded comments about the fabulous Victoria weather and we were treated to videos of what look to be very impressive facilities. What was impressive was the amount of Government support being thrown in behind next years conference. It sounds like they are going to co-locate with some traditional proprietary GIS vendors just so we can cause trouble.
I am a bit concerned that South Africa is out of the traditional target market for Open Source GIS; I hope this gives some local advocates a chance to shine.
The Closing Panel Discussion was amusing, with Tim Bowden doing his best to coax the rest of the panel into a semblance of disagreement with his quote of "GIS is dead". A great job all around.
The Sol Katz aware goes out for achievement in the field of open source geospatial software - and this year every one was pleased to see Stephen Lime recognized for his vast contributions; and kind hearted shepherding of MapServer over the years.
Paul Ramsey enjoyed putting an innocent bystander (Adena Schutzberg) on the spot for a bit of a recap. Adena went through some of the changes she has scene in our community as to grows up, and is starting to elbow around for more room. We are all acting with more confidence and it is nice to have that confirmed as we head out into a new year.

Pictures














Code Sprint

Last year we were a little bit terrible; we ended up gathering up laptops and ignoring the conference while we hacked away on things near and far. This year the organizers were kind enough to organize a "Code Sprint". We had a great time, and it freed us up to pay attention to our user community.
A great idea all around.
To celebrate we managed to break absolutely everything. After much talk, blood, sweat and occasional tears GeoTools is finally stepping out of the confines of a "flat" feature model (think database table) to the wider world of associations, properties and (gasp) operations. 
Given our ambition we did not finish in a day, or even three. As late as Tuesday the following a week a dedicated bunch of volunteers was still putting the parts back together.

Day 1

We started transition by "excluding" the usual GeoTools Feature and implementation classes from our build; and then went around fixing the compile errors.
Or we would of liked to but Internet / SVN access was spotty. We relocated after lunch to Refractions and proceeded to hack until all hours. Simone and the uDig crew joined us after 5pm and they had done amazing things with raster rendering speed (wow!).
Justin was lost into the abyss of main (updating a lot of dead code that is unused).
Jody was updating shapefile, CQL etc...
Zorn was kind enough to update the demo modules.
We were all very productive until David Blasby showed up and started getting everyone to play their presentations for him   :-)
After dinner we came back to Refractions and if anything rendering rasters in uDig was even more amazing.

Day 2

Chris Holmes and David Windslow joined the fray - David is getting a really scary introduction to GeoTools and is sending patches to Justin as he works through modules like validation
Andrea finished up renderer and jdbc and started in on PostGIS.
Jody finished up shape file.

Day 3

Starting up now - svn access seems to be down right now (boo hoo).
The gates have opened up on the jdbc datastores ... I think David and Chris will be working on that today.
Andrea is looking forward to updating his baby - PostGIS versioning.
Jody is proceeding with the wfs module.
I am pleased to report that today (a week later) Andrea was able to report back with an all clear!
Subject: Trunk builds for me
Hi all,
breaking news, I managed to finally get a full build out of trunk (the bad news is that it took 12minutes).
I just had to fix some unit tests in shapefile renderer, and while I was at it, fixed mysql as well (that is, made all of its runtime tests pass against a real database).
Now, we just need to get the server back in shape.
Cheers
Andrea
The combination of a successful gathering of the tribes, and with this roadblock removed, the future can only be better!