Serial Communication in Java with Raspberry Pi. Have been replaced by USB (Universal Serial Bus). Should talk to you via the wireless serial link. Java and RXTX. The Arduino IDE itself is written in Java, and it can communicate to the serial port via the RXTX Java library. (as with the Arduino serial monitor).
Contents • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • Using Java for Serial Communication [ ] Introduction [ ] Because of Java's platform-independence, serial interfacing is difficult. Serial interfacing requires a standardized API with platform-specific implementations, which is difficult for Java. Unfortunately, Sun didn't pay much attention to serial communication in Java. Sun has defined a serial communication API, called, but an implementation of the API was not part of the Java standard edition.
Sun provided a reference implementation for a few, but not all Java platforms. Particularly, at the end of 2005 Sun silently withdrew JavaComm support for Windows. Third party implementations for some of the omitted platforms are available. JavaComm hasn't seen much in the way of maintenance activities, only the bare minimum maintenance is performed by Sun, except that Sun apparently responded to pressure from buyers of their own Sun Ray thin clients and adapted JavaComm to this platform while dropping Windows support. This situation, and the fact that Sun originally did not provide a JavaComm implementation for Linux (starting in 2006, they now do) led to the development of the free-software library. RxTx is available for a number of platforms, not only Linux.
It can be used in conjunction with JavaComm ( RxTx providing the hardware-specific drivers), or it can be used stand-alone. When used as a JavaComm driver the bridging between the JavaComm API and RxTx is done by JCL ( JavaComm for Linux). JCL is part of the RxTx distribution. Sun's negligence of JavaComm and JavaComm's particular programming model gained JavaComm the reputation of being unusable. RxTx - if not used as a JavaComm driver - provides a richer interface, but one which is not standardized. RxTx supports more platforms than the existing JavaComm implementations.
Recently, RxTx has been adopted to provide the same interface as JavaComm, only that the package names don't match Sun's package names. So, which of the libraries should one use in an application? If maximum portability (for some value of 'maximum') is desired, then JavaComm is a good choice. If there is no JavaComm implementation for a particular platform available, but an RxTx implementation is, then RxTx could be used as a driver on that platform for JavaComm. So, by using JavaComm one can support all platforms which are either directly supported by Sun's reference implementation or by RxTx with JCL. This way the application doesn't need to be changed, and can work against just one interface, the standardized JavaComm interface. This module discusses both JavaComm and RxTx.
It mainly focuses on demonstrating concepts, not ready-to-run code. Those who want to blindly copy code are referred to the sample code that comes with the packages.
Those who want to know what they are doing might find some useful information in this module. JSSC (Java Simple Serial Connector) should also be considered There is also another library called jSerialComm that includes all its platform specific files in its jar, this makes it truly portable as there is no installation necessary. Getting started [ ] • Learn the basics of.
• Have the documentation of the device you want to communicate with (e.g. The modem) ready. • Set up all hardware and a test environment • Use, for example, a terminal program to manually communicate with the device. This is to be sure the test environment is set up correctly and you have understood the commands and responses from the device.
• Download the API implementation you want to use for your particular operating system • Read • the JavaComm and/or RxTx installation instruction (and follow it) • the API documentation • the example source code shipped Installation [ ] General Issues [ ] Both JavaComm and RxTX show some installation quirks. It is highly recommended to follow the installation instructions word-for-word. If they say that a jar file or a shared library has to go into a particular directory, then this is meant seriously! If the instructions say that a particular file or device needs to have a specific ownership or access rights, this is also meant seriously. Many installation troubles simply come from not following the instructions precisely.
It should especially be noted that some versions of JavaComm come with two installation instructions. One for Java 1.2 and newer, one for Java 1.1. Using the wrong one will result in a non-working installation. On the other hand, some versions/builds/packages of RxTx come with incomplete instructions.
In such a case the corresponding source code distribution of RxTx needs to be obtained, which should contain complete instructions. Many linux distributions offer a RxTx package in their repositories (ArchLinux - 'java-rxtx', Debian/Ubuntu - 'librxtx-java'), these packages include only the platform specific parts of the library, but are generally ready to use. It should be further noticed that it is also typical for Windows JDK installations to come with up to three VMs, and thus three extension directories. • One as part of the JDK, • one as part of the private JRE which comes with the JDK to run JDK tools, and • one as part of the public JRE which comes with the JDK to run applications Some even claim to have a fourth JRE somewhere in the Windows directory hierarchy. JavaComm should at least be installed as extension in the JDK and in all public JREs. Webstart [ ] JavaComm [ ] A general problem, both for JavaComm and RxTx is, that they resist installation via: JavaComm is notorious, because it requires a file called javax.comm.properties to be placed in the JDK lib directory, something which can't be done with Java WebStart.
This is particularly sad, because the need for that file is the result of some unnecessary design/decision in JavaComm and could have easily been avoided by the JavaComm designers. Sun constantly refuses to correct this error, citing the mechanism is essential. Which is, they are lying through their teeth when it comes to JavaComm, particular, because Java for a long time has a service provider architecture exactly intended for such purposes. The contents of the properties file is typically just one line, the name of the java class with the native driver, e.g.. Driver = com. Win32Driver The following is a hack which allows to deploy JavaComm via Web Start ignoring that brain-dead properties file.
It has serious drawbacks, and might fail with newer JavaComm releases - should Sun ever come around and make a new version. First, turn off the security manager. Some doofus programmer at Sun decided that it would be cool to again and again check for the existence of the dreaded javax.comm.properties file, even after it has been loaded initially, for no other apparent reason than checking for the file.
String driverName = 'com.sun.comm.Win32Driver'; // or get as a JNLP property CommDriver commDriver = ( CommDriver ) Class. ForName ( driverName ).
NewInstance (); commDriver. Initialize (); RxTx [ ] RxTx on some platforms requires changing ownership and access rights of serial devices.
This is also something which can't be done via WebStart. At startup of your program you could ask the user to perform the necessary setup as super user. Further, RxTx has a pattern matching algorithm for identifying 'valid' serial device names. This often breaks things when one wants to use non-standard devices, like USB-to-serial converters.
This mechanism can be overridden by system properties. See the RxTx installation instruction for details. JSerialComm [ ] jSerialComm in contrast to both RxTx and JavaComm is ready to use on many operating Systems and Platforms (e.g. Windows x86/x86_64, Linux x86/x86_64, ARM, and even android - full list in the specific library jar) without any changes. However it still needs permissions to access the device (more information on the ).
JavaComm API [ ] Introduction [ ] The official API for serial communication in Java is the JavaComm API. This API is not part of the standard Java 2 version. Instead, an implementation of the API has to be downloaded separately. Unfortunately, JavaComm has not received much attention from Sun, and hasn't been really maintained for a long time. From time to time Sun does trivial bug-fixes, but doesn't do the long overdue main overhaul. This section explains the basic operation of the JavaComm API. The provided source code is kept simple to demonstrate important point.
It needs to be enhanced when used in a real application. The source code in this chapter is not the only available example code. The JavaComm download comes with several examples.
These examples almost contain more information about using the API than the API documentation. Unfortunately, Sun does not provide any real tutorial or some introductory text. Therefore, it is worth studying the example code to understand the mechanisms of the API. Still, the API documentation should be studied, too. But the best way is to study the examples and play with them. Due to the lack of easy-to-use application and people's difficulty in understanding the APIs programming model, the API is often bad-mouthed. The API is better than its reputation, and functional.
The API uses a callback mechanism to inform the programmer about newly arriving data. It is also a good idea to study this mechanism instead of relying on polling the port. Unlike other callback interfaces in Java (e.g. In the GUI), this one only allows one listener listening to events.
If multiple listeners require to listen to serial events, the one primary listener has to be implemented in a way that it dispatches the information to other secondary listeners. Download & Installation [ ] Download [ ] Sun's web page points to a. Under this location Sun currently (2007) provides JavaComm 3.0 implementations for Solaris/SPARC, Solaris/x86, and Linux x86. Downloading requires to have registered for a Sun Online Account. The download page provides a link to the registration page. The purpose of this registration is unclear. One can download JDKs and JREs without registration, but for the almost trivial JavaComm Sun cites legal and governmental restrictions on the distribution and exportation of software.
The Windows version of JavaComm is no longer officially available, and Sun has - against their own product end-of-live policy - not made it available in the. However, the 2.0 Windows version (javacom 2.0) is still downloadable from. Installation [ ] Follow the installation instructions that come with the download. Some versions of JavaComm 2.0 come with two installation instructions.
The most obvious of the two instructions is unfortunately the wrong one, intended for ancient Java 1.1 environments. The information referring to the also ancient Java 1.2 (jdk1.2.html) is the right one. Particularly Windows users are typically not aware that they have copies of the same VM installed in several locations (typically three to four). Some IDEs also like to come with own, private JRE/JDK installations, as do some Java applications.
The installation needs to be repeated for every VM installation (JDKs and JREs) which should be used in conjunction with the development and execution of a serial application. IDEs typically have IDE-specific ways of how a new library (classes and documentation) is made known to the IDE. Often a library like JavaComm not only needs to be made known to the IDE as such, but also to each project that is supposed to use the library. Read the IDE's documentation.
It should be noted that the old JavaComm 2.0 version comes with JavaDoc API documentation that is structured in the historic Java 1.0 JavaDoc layout. Some modern IDEs are no longer aware of this structure and can't integrate the JavaComm 2.0 documentation into their help system. In such a case an external browser is needed to read the documentation (a recommended activity.). Once the software is installed it is recommended to examine the samples and JavaDoc directories. It makes sense to build and run one of the sample applications to verify that the installation is correct. The sample applications typically need some minor adaptations in order to run on a particular platform (e.g.
Changes to the hard-coded com port identifiers). It is a good idea to have some serial hardware, like cabling, a null modem, a breakout box, a real modem, PABX and others available when trying out a sample application. And provide some information on how to set up the hardware part of a serial application development environment. Finding the desired serial Port [ ] The first three things to do when programming serial lines with JavaComm are typically • to enumerate all serial ports (port identifiers) available to JavaComm, • to select the desired port identifier from the available ones, and • to acquire the port via the port identifier. Enumerating and selecting the desired port identifier is typically done in one loop. // Read the response String response = is. ReadLine (); // if you sent 'AT' then response == 'OK' Problems with the simple Reading / Writing [ ] The simple way of reading and/or writing from/to a serial port as demonstrated in the previous sections has serious drawbacks.
Both activities are done with blocking I/O. That means, when there is • no data available for reading, or • the output buffer for writing is full (the device does not accept (any more) data), the read or write method ( os.print() or is.readLine() in the previous example) do not return, and the application comes to a halt. More precisely, the thread from which the read or write is done gets blocked. If that thread is the main application thread, the application freezes until the blocking condition is resolved (data becomes available for reading or device accepts data again). Unless the application is a very primitive one, freezing of the application is not acceptable. For example, as a minimum some user interaction to cancel the communication should still be possible.
What is needed is non-blocking I/O or asynchronous I/O. However, JavaComm is based on Java's standard blocking I/O system ( InputStream, OutputStream), but with a twist, as shown later. The mentioned 'twist' is that JavaComm provides some limited support for asynchronous I/O via an event notification mechanism. But the general solution in Java to achieve non-blocking I/O on top of the blocking I/O system is to use threads. Indeed, this is a viable solution for serial writing, and it is strongly recommended to use a separate thread to write to the serial port - even if the event notification mechanism is used, as explained later.
Reading could also be handled in a separate thread. However, this is not strictly necessary if the JavaComm event notification mechanism is used. So summarize: Activity Architecture reading use event notification and/or separate thread writing always use separate thread, optionally use event notification The following sections provide some details. Event Driven Serial Communication [ ] Introduction [ ] The JavaComm API provides an event notification mechanism to overcome the problems with blocking I/O. However, in the typical Sun manner this mechanism is not without problems. In principle an application can register event listeners with a particular SerialPort to be kept informed about important events happening on that port.
The two most interesting event types for reading and writing data are • javax.comm.SerialPortEvent.DATA_AVAILABLE and • javax.comm.SerialPortEvent.OUTPUT_BUFFER_EMPTY. But there are also two problems: • Only one single event listener per SerialPort can be registered. This forces the programmer to write 'monster' listeners, discriminating according to the event type. • OUTPUT_BUFFER_EMPTY is an optional event type. Well hidden in the documentation Sun states that not all JavaComm implementations support generating events of this type. Before going into details, the next section will present the principal way of implementing and registering a serial event handler.
Remember, there can only be one handler at all, and it will have to handle all possible events. Setting up a serial Event Handler [ ]. SerialPort port =.. // // Configure port parameters here. Only after the port is configured it // makes sense to enable events. The event handler might be called immediately // after an event is enabled.
// // Typically, if the current class implements the SerialEventListener interface // one would call // // port.addEventListener(this); // // but for our example a new instance of SerialListener is created: // port. AddEventListener ( new SerialListener ()); // // Enable the events we are interested in // port. NotifyOnDataAvailable ( true ); port.
NotifyOnOutputEmpty ( true ); /* other events not used in this example ->port.notifyOnBreakInterrupt(true); port.notifyOnCarrierDetect(true); port.notifyOnCTS(true); port.notifyOnDSR(true); port.notifyOnFramingError(true); port.notifyOnOverrunError(true); port.notifyOnParityError(true); port.notifyOnRingIndicator(true). This section is a stub. You can help Wikibooks. Using a separate thread for writing has one purpose: Avoiding that the whole application blocks in case the serial port is not ready for writing. A simple, thread-safe Ring Buffer Implementation [ ] Using a separate thread for writing, separate from some main application thread, implies that there is some way to hand off the data which needs to be written from the application thread to the writing thread. A shared, synchronized data buffer, for example a byte[] should do. Further, there needs to be a way for the main application to determine if it can write to the data buffer, or if the data buffer is currently full.
In case the data buffer is full it could indicate that the serial port is not ready, and output data has queued up. The main application will have to poll the availability of new space in the shared data buffer. However, between the polling the main application can do other things, for example updating a GUI, providing a command prompt with the ability to abort the sending, etc. At first glance a PipedInputStream/PipedOutputStream pair seems like a good idea for this kind of communication.
But Sun wouldn't be Sun if the a piped stream would actually be useful. PipedInputStream blocks if the corresponding PipedOutputStream is not cleared fast enough.
So the application thread would block. Exactly what one wants to avoid by using the separate thread. Snapper Serial Number Year on this page. A java.nio.Pipe suffers from the same problem. Its blocking behavior is platform dependent. And adapting the classic I/O used by JavaComm to NIO is anyhow not a nice task.
In this article a very simple synchronized ring buffer is used to hand over the data from one thread to another. In a real world application it is likely that the implementation should be more sophisticated.
In a real world implementation it would make sense to implement OutputStream and InputStream views on the buffer. A ring buffer as such is nothing special, and has no special properties regarding threading. It is just that this simple data structure is used here to provide data buffering. The implementation is done so that access to this data structure has been made thread safe. This section is a stub. You can help Wikibooks. Modem Control [ ] JavaComm is strictly concerned with the handling of a serial interface and the transmission of data over that interface.
It does not know, or provide, any support for higher-layer protocols, e.g. For Hayes modem commands typically used to control consumer-grade modems. This is simply not the job of JavaComm, and not a bug. Like with any other particular serial device, if the control of a modem is desired via JavaComm the necessary code has to be written on top of JavaComm. The page provides the necessary basic generic information to deal with Hayes modems. Some operating systems, e.g. How To Install Wii Mod Batch Book. Windows or certain Linux distributions provide a more or less standardized way how modem control commands for a particular modem type or brand are configured for the operating system.
Windows modem 'drivers', for example, are typically just registry entries, describing a particular modem (the actual driver is a generic serial modem driver). JavaComm as such has no provisions to access such operating-system specific data. Therefor, one either has to provide a separate Java-only facility to allow a user to configure an application for the usage of a particular modem, or some platform-specific (native) code needs to be added. This section is a stub. You can help Wikibooks. Overview and Versions [ ] Due to the fact that Sun didn't provide a reference implementation of the JavaComm API for Linux, people developed RxTx for Java and Linux.
RxTx was then further ported to other platforms. The latest version of RxTx is known to work on 100+ platforms, including Linux, Windows, Mac OS, Solaris and other operating systems. RxTx can be used independent of the JavaComm API, or can be used as a so called provider for the JavaComm API. In order to do the latter, a wrapper called JCL is also needed. JCL and RxTx are usually packaged together with Linux/Java distributions, or JCL is completely integrated into the code.
So, before trying to get them separately, it is worth having a look at the Linux distribution CD. There seems to be a trend to abandon the JavaComm API, and using RxTx directly instead of via the JCL wrapper, due to Sun's limited support and improper documentation for the JavaComm API. However, RxTx's documentation is extremely sparse.
Particularly, the RxTX people like to make a mess of their versions and package contents (e.g. With or without integrated JCL). Starting with RxTx version 1.5 RxTx contains replacement classes for the public JavaComm classes. For legal reasons they are not in the java.comm package, but in the gnu.io package.
However, the two currently available RxTx versions are packaged differently: RxTx 2.0 RxTx version supposed to be used as a JavaComm provider. This one is supposed to have its roots in RxRx 1.4, which is the RxTx version before the gnu.io package was added. RxTx 2.1 RxTx version with a full gnu.io package replacement for java.comm. This version is supposed to have its roots in RxTx 1.5, where gnu.io support started. So, if one wants to program against the original JavaComm API one needs • Sun's generic JavaComm version.
As of this writing this is in fact the Unix package (which contains support for various Unix versions like Linux or Solaris). Even when used on Windows, the Unix package is needed to provide the generic java.comm implementations. Only the part implemented in Java is used, while the Unix native libraries are just ignored. • RxTx 2.0 in order to have a different provider below the generic generic JavaComm version than the ones comming with the JavaComm package However, if one just wants to program against the gnu.io replacement package, then • only RxTx 2.1 is needed. Converting a JavaComm Application to RxTx [ ] So, if you belong to the large group of people who have been let down by Sun when they dropped Windows support for JavaComm, you are in need to convert a JavaComm application to RxTx. As you can see from the above, there are two ways to do it.
Both assume that you manage to install a version of RxTx first. Then the options are either • Using RxTx 2.0 as a JavaComm provider • Porting the application to RxTx 2.1 The first option has already been explained. The second option is surprisingly simple. All one has to do to port some application from using JavaComm to using RxTx 2.1 is to replace all references to java.comm in the application source code with references to gnu.io. If the original JavaComm application was properly written there is nothing more to do. RxTx 2.1 even provides the tool contrib/ChangePackage.sh to perform the global replacement on a source tree under Unix.
On other platforms such a global replacement is easy to do with IDEs supporting a decent set of refactoring features. See also [ ] • on github - with information on how to use it - • • • • (Files are accessible with only (May 2017)) • on github - a new Wrapper to RxTx with a 'new improved API compared to that of RXTX' • • • Ben Resner has and • is easy to use Open Source serial port library for Windows and Linux].