Apache Camel - FUSE community day London 2010 presentation

Apache Camel

Claus Ibsen
Principal Software Engineer, Progress Software
June 2010

1
Tuesday, June 8, 2010

Agenda

 Who is Claus Ibsen?
 The birth of Apache Camel
 What is Apache Camel
 A little example
 Whats included in the box?
 Running Camel
 The Camel Community
 Where are we today?
 Where are we going tomorrow?
 Q and A

2 © 2009 Progress Software Corporation


Who is Claus Ibsen?

 Principal Software Engineer at Progress Software
• Full time Apache Camel hacker
 Apache Camel committer for 2+ years
• 30 months working with Camel
 Co-author of Camel in Action book
• Available in Q3 2010
 Contact
• cibsen@progress.com
• claus.ibsen@gmail.com
• http://davsclaus.blogspot.com/
• http://twitter.com/davsclaus



Agenda

 Running Camel
 Q and A



The birth of Apache Camel

• Camel’s parents




 Initial Commit Log
r519901 | jstrachan | 2007-03-19 11:54:57 +0100
(Mon, 19 Mar 2007) | 1 line

Initial checkin of Camel routing library

 Apache Camel 1.0 released June 2007

 Apache Camel is 3 years old




 My initial commit

r640963 | davsclaus | 2008-03-25 21:07:10 +0100
(Tue, 25 Mar 2008) | 1 line

Added unit test for mistyped URI



Agenda

 Running Camel
 Q and A



What is Apache Camel

 Quote from the web site

Apache Camel is a
Powerful Open Source
Integration Framework
based on known
Enterprise Integration Patterns




 What are Enterprise Integration Patterns?





Its a book



 Lets look at one of the patterns




 Use Case

ActiveMQ WebSphereMQ




 Filter Pattern




 Filter Pattern

from filter send to
A message B




 Filter Pattern

from(A) filter(predicate) to(B)




 Filter Pattern

from(A) .filter(isWidget) .to(B)




 Filter Route

from(A).filter(isWidget).to(B);




 Filter Route

isWidget = xpath(“/quote/product = ‘widget’”);





 Filter Route

Endpoint A = endpoint(“activemq:queue:quote”);

Endpoint B = endpoint(“mq:quote”);

Predicate isWidget = xpath(“/quote/product = ‘widget’”);





 Filter Route - Java DSL

public void configure() throws Exception {
Endpoint A = endpoint("activemq:queue:quote");
Endpoint B = endpoint("mq:quote");
Predicate isWidget = xpath("/quote/product = ‘widget’");

}





import org.apache.camel.builder.RouteBuilder;
import static org.apache.camel.builder.xml.XPathBuilder.xpath;

public class FilterRoute extends RouteBuilder {

Endpoint A = endpoint("activemq:queue:quote");
Endpoint B = endpoint("mq:quote");
Predicate isWidget = xpath("/quote/product = ‘widget’");

}
}





import org.apache.camel.builder.RouteBuilder;

public class FilterRoute extends RouteBuilder {

from("activemq:queue:quote")
.filter().xpath("/quote/product =‘widget’")
.to("mq:quote");
}
}




 IDE Tooling
Code
Assistance

JavaDoc




 IDE Tooling

Code
Assistance




 Recap - Concepts of Camel
• Enterprise Integration Patterns
• Routing
• Domain Specific Language (DSL)
• Endpoints
• URIs
• Predicates & Expressions
• Components

and much more ...

Simplify Integration




 Lets look at the most famous pattern




 Content Based Router




 Content Based Router - Spring XML
<camelContext>
<route>
<from uri="activemq:NewOrders"/>
<choice>
<when>
<xpath>/order/product = 'widget'</xpath>
<to uri="activemq:Orders.Widgets"/>
</when>
<otherwise>
<to uri="activemq:Orders.Gadgets"/>
</otherwise>
</choice>
</route>
</camelContext>



 Content Based Router - Java DSL

from("activemq:NewOrders")
.choice()
.when().xpath(“/order/product = 'widget'”)
.to(“activemq:Orders.Widget”);
.otherwise()
.to(“acitvemq:Orders.Gadget”);



Agenda

 Running Camel
 Q and A



A little example

 Based on community user (Gunnar Hillert)
• http://hillert.blogspot.com/2009/09/camellos-discovering-apache-
camel-ii.html
 Goals
• 1) Pickup files from a directory
• 2) Make sure we only pickup 3 files per 30 seconds
• 3) Store into JMS queue
• 4) Listen on JMS queue
• 5) And upload file to FTP server



A little example

 Goals using Enterprise Integration Patterns

1 2 3 4 5

 Goals



A little example

 Goals using Enterprise Integration Patterns

from throttle to from to
 Goals



A little example

 Camel DSL in XML
<camelContext>
<route>
<from uri="file:camellos/inbox?move=.done"/>
<throttle maximumRequestsPerPeriod="3”
timePeriodMillis="30000”>
<to uri="activemq:queue:camellos"/>
</throttle>
</route>
<route>
<from uri="activemq:queue:camellos"/>
<to uri="ftp://admin:secret@localhost:3333"/>
</route>
</camelContext>



Agenda

 Running Camel
 Q and A



Whats included in the box?

 Highlights of whats included in Camel




 70+ Components
activemq crypto ﬂatpack irc ldap

activemq-journal cxf freemarker javaspace mail/imap/pop3

amqp cxfrs ftp/ftps/sftp jbi mina

atom dataset gae jcr mock

bean direct hdfs jdbc msv

bean validation esper hibernate jetty nagios

browse event hl7 jms netty

cache exec http jpa nmr

cometd ﬁle ibatis jt/400 printer

http://camel.apache.org/components.html




 70+ Components
properties scalate stream xslt

quartz seda string-template ejb

quickﬁx servlet test

ref smooks timer

restlet smpp validation

rmi snmp velocity

rnc spring-integration vm

rng spring-security xmpp

rss sql xquery

http://camel.apache.org/components.html




 18 Data Formats
bindy protobuf
castor serialization
csv soap
crypto tidy markup
ﬂatpack xml beans
gzip xml security
hl7 xstream
jaxb zip
json dozer

http://camel.apache.org/data-format.html




 Data Format

from("activemq:QueueWithJavaObjects”)
.marshal().jaxb()
.to("mq:QueueWithXmlMessages");




 Predicates & Expressions

BeanShell PHP
EL Python
Groovy Ruby
JavaScript Simple
JSR 223 SQL
OGNL XPath
MVEL XQuery

http://camel.apache.org/languages.html




 DSL in 3 programming languages
Java
XML
<route>
<from ref="A"/>
<filter>
<xpath>/quote/product = ‘widget’</xpath>
<to ref="B"/>
</filter>
</route>
from(A) filter(isWidget) --> B

Scala




 Type Converters

INFO DefaultTypeConverter
- Loaded 148 type converters




 Custom Type Converters
@Converter
public class MyTypeConverter {
@Converter
public String toString(MyOrder order) {
StringBuilder sb = new StringBuilder();
...
return sb.toString();
}
}
# META-INF/services/org/apache/camel/TypeConverter
com.acme.converters
META-INF file in the JAR



 Powerful bean integration
• Adapt to your beans
• EIP as @annotations
- @Produce
- @Consume
- @RecipientList
- @RoutingSlip

more to come in future releases ...




 Bean as Message Translator




 Bean as Message Translator
from("activemq:Incoming”).
beanRef("myBeanName”, “someMethod").
to("activemq:Outgoing");

public class Foo {

public String someMethod(String name) {
return “Hello “ + name;
}
}




 Bean Parameter Binding with XPath

public class Foo {

public String processOrder(
String orderAsXml,
@XPath(”/order/@id”) String oid,
@Header(”JMSCorrelationID”) String cid) {
...
}
}




 Bean Parameter Binding with Languages

public class Foo {

public void processOrder(
MyOrder order,
@Simple(”${body.customer.gold}”) boolean gold) {
...
}
}

MyOrder
- id Customer
- customer - gold
- street
- zip



 Sending message

public class Foo {
@Produce(uri="activemq:foo.bar")
ProducerTemplate producer;

public void doSomething() {
if (whatever) {
producer.sendBody("<hello>world!</hello>");
}
}
}




 Sending message w/ interface

public interface EchoService {
String sayEcho(String echo);
}




 Sending message w/ interface

public class Echo {
@Produce(uri="http://somewhere/echo")
EchoService echo;

public void doTheEcho() {
String reply = echo.sayEcho("Hi");
}
}




 Sending message w/ no Camel API
<proxy id="echo"
serviceInterface="com...EchoService"
serviceUrl="http://somewhere/echo"/>

public class Echo {
@Autowired
EchoService echo;

public void doTheEcho() {
String reply = echo.sayEcho("Hi");
}
}




 The EJB MessageDrivenBean in Camel

public class Foo {

@Consume(uri="activemq:cheese")
public void onCheese(String name) {
...
}
}




 Test Kit
• JUnit based (3.x and 4.x)
• Supports Spring
• Easy to test
• Quick prototyping




extend CamelTestSupport
 Test Kit from IDE
Right Click ->
Run
Debug

Inline RouteBuilder




 Managed
• JMX API
• REST API




 Web console
• REST API




 Maven tooling
• Maven Archetypes to create new projects

mvn archetype:generate
-DarchetypeGroupId=org.apache.camel.archetypes
-DarchetypeArtifactId=camel-archetype-war
-DarchetypeVersion=2.3.0

• Maven goals to run project
- mvn camel:run
- mvn jetty:run



Agenda

 Running Camel
 Q and A



Running Camel

 Riding the Camel



Running Camel

 Java Application
CamelContext context = new DefaultCamelContext();
context.addRoutes(new MyRouteBuilder());
context.start();

 Spring Application
<camelContext>
<package>com.acme.quotes</package>
</camelContext>



Running Camel

 Lightweight
 Embeddable
 Known Deployment Options
• Standalone Java Application Known Containers
• Web Application Apache ServiceMix
Apache ActiveMQ
• J2EE Application
Apache Tomcat
• JBI Jetty
• OSGi JBoss
IBM WebSphere
• Google App Engine BEA WebLogic
• Java Web Start Oracle OC4j
• Spring Application GAE
... others



Agenda

 Running Camel
 Q and A



The Camel Community

 Camel website
• 40% increase (comparing last two 6 month periods)
• 2000-2500 visits per weekday

 High activity on mailing list

http://old.nabble.com/



The Camel Community

 High activity on mailing list (cont.)

http://markmail.org/



The Camel Community

 20 committers

 High commit activity

http://markmail.org/



The Camel Community

 JIRA tickets

Total 2795

Open 154 (6%)

Resolved 2641 (94%)

Bugs 11 (7% open)

Oldest Bug June/29/09

June 8th 2010



The Camel Community

 A lot in each new release

Release Date Tickets

Camel 2.0 Aug 2009 760

Camel 2.1 Dec 2009 303

Camel 2.2 Feb 2010 180

Camel 2.3 May 2010 273



The Camel Community

 Contributors
• 6 new contributed components in Camel 2.3

 Contributor --> Committer

meritocracy



The Camel Community

 3rd party integrating Camel
• Apache ServiceMix
• Apache ActiveMQ
• Apache James In Progress
• OpenESB • Drools
• Progress Actional Diagnostics • Smooks
• FuseHQ • Doozer
• Open eHealth Integration Platform • JBossESB
• Grails Camel Plugin
• Play Framework
• Akka
• Scalate



Agenda

 Running Camel
 Q and A



Where are we today?

 Some highlights of Apache Camel 2.3
• Overhauled Aggregator EIP
• Easier thread pool configuration
• Properties component
• <routeContext> in Spring XML
• 10+ new components



Where are we today?

 Overhauled Aggregator EIP
• 5 independent completion conditions
- size
- timeout
- interval
- predicate
- batch consumer
• Parallel publishing
• Persistent
http://hawtdb.fusesource.org/
• Transactional



Where are we today?




Where are we today?


X


Where are we today?




Where are we today?

 Easier thread pool configuration

EIPs
Background
Tasks
Thread
Pools

Components



Where are we today?

Background
EIPs
Tasks

Executor
Service
Strategy
Thread
Pools
Components



Where are we today?

 ExecutorServiceStrategy
• API for creating and lookup thread pools
• Consistent thread names
• Register pools with JMX
• Handle lifecycle (shutdown)

Easier for Component writers



Where are we today?

 ThreadPoolProfile
• Template defining pool settings
• 1 default profile
• 0..n custom profiles

<threadPoolProfile id="fooProfile"
poolSize="20" maxPoolSize="50"
maxQueueSize="200"/>

Easier for end users



Where are we today?

 Properties Component Properties
Component
File

{{key}}

<from uri=“jms:queue:{{inbox}}”/>
<to uri=“bean:validateOrder”/>



Where are we today?

 <routeContext> in Spring XML
• Re-usable route templates (in separate Spring XML files)

<routeContext id="myCoolRoutes">
<route id="cool">
<from uri="direct:start"/>
<to uri="mock:result"/>
</route> myCoolRoutes.xml
</routeContext>

<import resource="myCoolRoutes.xml"/>
<camelContext>
<routeContextRef ref="myCoolRoutes"/>
</camelContext>


Where are we today?

 10+ new components
• Properties
• Nagios
• Netty
• Exec
• JSR-303 bean validator
• Spring Security
• Java Cryptographic Extension
• OAuth and Google Login to GAE
• Eclipse RCP
• SOAP (JAXB and JAX-WS)



Agenda

 Running Camel
 Q and A



Where are we going tomorrow?

 Roadmap for Apache Camel 2.4
 The major targets
• Asynchronous routing engine
• OSGi improvements (blueprint etc.)
• Security in DSL
• Apache ODE component (BPEL) ?
 Schedule
• GA in Q3 2010



Agenda

 Running Camel
 Q and A



Q and A

 Where do I get more information?
- Camel website: http://camel.apache.org
- FUSE website: http://fusesource.com
- Camel in Action book: http://manning.com/ibsen



Q and A

?


Apache Camel - FUSE community day London 2010 presentation

Related slideshows

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

Recommended for you

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (10)

Similar to Apache Camel - FUSE community day London 2010 presentation

Similar to Apache Camel - FUSE community day London 2010 presentation (20)

More from Claus Ibsen

More from Claus Ibsen (15)

Recently uploaded

Recently uploaded (20)

Apache Camel - FUSE community day London 2010 presentation