Dyalog ’22 Day 1: Welcome to Sunny Olhão!

Arriving to meet the warm sea air is already a refreshing change as this year’s long, hot summer started to close in the weeks leading up to this year’s user meeting. Of course, for some with less far to travel, the warmth is a familiar comfort.

Apartments at the Real Marina in Olhão, Portugal

Apartments at the Real Marina in Olhão, Portugal

As delegates arrived on Sunday night we were treated to a lovely surprise – a birthday cake to celebrate Tony Corso’s birthday! Happy Birthday, Tony!

Today we kicked off the user meeting with workshops, giving delegates hands-on experience with a range of Dyalog offerings for application development.

Attendees of Rich Park and Rodrigo Girão Serrão’s language workshops explored different ways to express ideas in APL using both tried and true idioms in the morning and newer language features in the afternoon – they compared expressiveness and performance implications in difference circumstances.

Morten and Josh got participants up to speed with using and maintaining code which lives outside of your workspace in text files, while Richard Smith and Bjørn Christensen showed how to manage and interact with data from outside of the workspace.

Brian Becker guided delegates into the world of SAAS (Software As A Service). It is encouraging to see how straightforward having APL code talk to the outside world can be. As usual, however, the complexities reveal themselves as you delve deeper in to specific use cases and circumstances.

Morten presents a Dyalog workshop

Morten and Josh show how to store source code as text files using Link

Without a doubt, getting to meet our users face to face has already proved to be the greatest enjoyment of the meeting so far. Some familiar faces long since last seen, and others only over a screen. Discussing ideas face to face still retains a value impossible to quantify.

Overall a fantastic beginning to the week and we cannot wait to experience the rest of this week!

APL Seeds ’22: Tuesday 29 March

On Tuesday 29 March we hosted APL Seeds ’22, the second annual online event for new and prospective users of APL (although everyone was welcome). Once again we were delighted to see that the majority of registrants had little to no APL experience; it feels like we get the chance to offer that same sense of discovery we felt when first learning about the language.

APL Seeds ’22 began with an introduction from Dyalog Ltd’s managing director, Gitte Christensen, in which she described her experiences of seeing APL enable people who had real problems to solve and showed some of what Dyalog provides in terms of the tools and interfaces that people might expect from a modern software development stack. Gitte explained the new Basic Licence, which is another step forward in Dyalog Ltd’s aim to bring APL to a wider audience. The Basic Licence allows non-commercial distribution of Dyalog along with APL-based solutions under the terms of the Royalty-Based Run-Time Licence, which will apply as the default run-time licence (see Prices and Licences for more information on Basic Licences). She also described some customer use cases, some of which might surprise newcomers to this language. Rich Park finished the introduction by pointing out where you can find more APL content, especially if you’re just getting started. For example, our tips for beginners includes things that might not be obvious when you first start the interpreter or read introductory books. The video description for the recording of this presentation contains many useful links!

APL is an executable notation and tool of thought which enables people with good ideas to bring them to life with computers

Gitte opens the event with her thoughts on “What is APL?”, including the short expression 1 2 3 + 4 5 6 that started the journey which eventually brought her to Dyalog.

Rich then presented a basic introduction to APL, showing the benefits of a symbolic notation for programming as well as demonstrating how to put together simple building blocks to build a function. After introducing the basic syntax, right-to-left precedence, and the generality of APL operators, along with a handful of symbols including the famous outer product (⍺∘.F⍵) and array indexing (⍺[⍵]), he walked through constructing a function that visualised the probability distribution for sums of rolling two N-sided dice.

A screenshot of an APL function to do some simple statistical computation and display the output using characters in the APL REPL

The Dist function uses just a handful of APL constructs to create a visualisation of a simple statistical distribution.

Stefan Kruger, author of the online book Learning APL, took us on an exploration of bioinformatics problems – a popular topic for the annual APL Problem Solving Competition. He described what a “k-mer” is (a chunk of DNA of a particular length), and compared different techniques for cutting up a text vector to isolate them from a DNA string, including a windowed-reduction (⍺F/⍵) and its generalised cousin, the stencil operator ((⍺⍺⌺⍵⍵)⍵), and our old friends the outer product and array indexing. Finally, Stefan looked at three approaches to doing some simple statistics in the Rosalind challenge “Computing GC Content“. To our delight, a new user who was in attendance commented that they learned new expressions and idioms that they had not seen before.

Stefan compares 3 functions to split a string into lengh-4 substrings

Stefan compares 3 functions to split a string into lengh-4 substrings

Andrew Sengul presented a more involved example, April. The April APL Compiler is a new entry in the APL field, compiling a subset of APL into the Common Lisp language and allowing APL functions to easily be used within Common Lisp programs. Andrew gave a concise history comparing Lisp and APL. He then gave a small introduction to using Lisp to write a “macro” (code that generates other code) before giving a glimpse into the implementation, architecture and design of APL in Common Lisp, as well as code that combines APL and Lisp to create visualisations. He showed a visualisation that used APL to both run Conway’s Game of Life and apply convolution kernels to show the state of cells over time. We loved seeing how he has been using April in the visual art installation Bloxl (a collection of computer-controlled light-up blocks used at events for a stunning visual effect). Andrew concluded his presentation with a demonstration of April code implementing a “falling block game”, and a video of that game in action.

Andrew gives a comparative overview of the histories of the APL and Lisp programming languages

Andrew gives a comparative overview of the histories of the APL and Lisp programming languages

Finally, there was a live recording of an episode of Array Cast, a semi-weekly podcast about array languages. From the regular panel of presenters were self-proclaimed J enthusiast Bob Therriault, Kx Librarian Stephen Taylor, Dyalog tools developer and life-long APL programmer Adám Brudzewsky, and professional C++ developer and programming language fanboy Conor Hoekstra. They were joined by a very special panel of guests: speakers from the event Gitte Christensen, Rich Park, Stefan Kruger, and Andrew Sengul, and well-known APLers Aaron Hsu and Rodrigo Girão Serrão.

The discussion began with the common beginners’ questions of keyboards, typing APL and whether you really need stickers, keycaps or a whole dedicated APL keyboard to use APL. On the topic of actually learning APL, there were mentions of even more books and other resources, including YouTube channels run by some of the podcast panellists and guests. All relevant links are included in the show notes for the episode, and you can listen to the episode on arraycast.com.

Taking a more technical turn, there was discussion of the balance between code clarity and performance. Should code be clear unless absolutely performance critical? Or is it possible to have both, where the clearer encodings and approaches are also the fastest? The episoded was capped off nicely, in response to a question from the audience, with Gitte offering her perspective on how APL can help a data analyst or engineer.

In the informal meet-up after the talks, Andrew configured a simple interface to the aforementioned “falling block puzzle game”, in which participants could control the game and see their moves played out on a Bloxl wall streamed in real (if a bit delayed) time. The players tried their best but were ultimately thwarted by the interface of clicking buttons using Zoom shared controls!

To those who attended, we hope you found the event enjoyable. Relevant materials have been uploaded to the APL Seeds ’22 webpage, including links to recordings of the presentations on dyalog.tv.

APL Seeds ’21: Wednesday 31 March

Last Wednesday we hosted APL Seeds ’21, an event for those just starting their APL journey. Although we knew we had a good programme with some exceptional presenters in place, we very quickly had to increase our Zoom webinar limit to accommodate the 287 people who registered to attend! We were surprised and excited by the demographic, spanning 32 countries and with the vast majority having only basic or no APL experience.






The meeting started with a brief introduction from Dyalog’s Managing Director, Gitte Christensen, who shared her initial “Eureka” APL moment and gave some examples of situations in which APL is used today. Richard Park then took us on a whirlwind tour of APL’s past (including the very cool 1975 APL demonstration!) before demystifying the “beautiful squiggles” that define APL and introducing the modern resources that are available for learning APL (for a summary of these see the suggestions for learning resources available on our website).

The main presentations began with Rodrigo Girão Serrão giving a basic introduction to APL functions and syntax. Using the example of manually justifying text, he showed just how natural it is to process data in arrays by combining a few functions and operators. His initial exploration using a small snippet of text worked instantaneously and without issue on a whole book. After seeing this, hopefully you’ll feel an urge to learn some more – either because you got hooked (like Rodrigo did!) or simply because you want to learn how to think in an array-oriented way, which is very relevant in many situations today, such as when working with GPUs.

Martin Janiczek used a real-life example from the market insights and consumer trends company that he works for (GWI). Despite being a self-described “APL baby”, having learned APL for only around a month, he was able to get to grips with the tree structures that he wanted to use, and talked about how learning APL led him to change his overall approach to the problem. He achieved a highly-performant working prototype in two weeks and with only 172 lines of code, despite starting from the position of a complete APL beginner. Although ultimately his APL model was not taken into production, it inspired a complete rethink and new approach in the eventual product.

Conor Hoekstra (NVIDIA) describes himself as “not an APLer but a big fan”, and his enthusiasm is obvious and contagious! His explorations in APL are YouTube famous, and here again he deftly shows how APL can be used as a tool of thought to explore problems from many different angles with relative ease. He went through multiple different solutions to writing an All Equals function (is every element in a list the same as every other element?), playing with different primitives and comparing the performance of the solutions.

The final presentation came from Tomas Gustafsson, creator of the stunning Stormwind boating simulator. Tomas introduced the technology behind the 3D engine that he uses for his simulator, explaining the code that makes it all happen, before walking us through creating some simple 3-D shapes (a rotating triangle and an icosahedron) and the pitfalls that this entails. From the comments we know he seemed to inspire several members of the audience to want to know more… so for those of you that do, his code examples will soon be available from the APL Seeds web page.

We hope everyone found the event useful and enjoyable (the feedback seems to indicate that you did – thank you!). Relevant materials have started to be uploaded to the APL Seeds ’21 webpage – this page also includes links to recordings of the presentations, which are all on dyalog.tv:

 

Dyalog ’19: Thursday 12 September

Dyalog Pictures Ltd?

After a wonderful banquet dinner bonding with fellow teammates of last night’s Viking Challenge, we were invited to the Jorns Auditorium for the world premiere of our movies from earlier in the day. The screening and awards show was a roaring success with everybody being surprised and thrilled at the quality of what came out from the editing room. We would like to thank Filmteambuilding.dk for an incredibly enjoyable afternoon and evening.

How do I… in APL?

In another world premiere, Adám Brudzewsky introduced us to APLcart this morning. This is the new answer to the question “how do I… in APL?”. Luckily Adám’s presentation strategy of asking the audience for functionality to search for was a win-win – if APLcart had it then we were impressed, and if not Adám had a new item to add to APLcart. Try it now and see if APLcart has what you’re looking for. If you can’t, Adám invites you to email the functions you want to see to adam(AT)aplcart.info.

Richard Park then gave his third and final presentation of the week on the theme of using APL for education. He showed us how you can quickly and easily create Dyalog Jupyter notebooks and recommended using them for how-to, instructional documents and problem sets for students. You can view and download his presentation (which is a notebook) from GitHub, and interact with the live running notebook by clicking this button → .

Tomas Gustafsson tells the Irma story

We then had the final talk of the User Meeting. Tomas Gustafsson, creator of the Stormwind boating simulator, told us the fascinating story of the Finnish ship M/S Irma. It disappeared while travelling a common route in 1968 and became one of the greatest mysteries in Finnish maritime history. Eventually some wreckage was found near Åland and Tomas was able to use APL, reconstructing possible paths of the debris via simulation, to make an educated guess of where to search for the main wreckage.

Lastly Gitte expressed to us how enjoyable the week had been, and all in the audience seemed to agree. We thanked Helene, Karen, Jason, Fiona and all of the staff at Konventum for their hard work “behind the scenes” to make the User Meeting run smoothly.

For the last afternoon of the User Meeting three final workshops were held. Two focused on technical software development issues, with Morten and Josh answering users’ questions related to using text-based source with ]LINK and Git. Andy Shiers and John Daintree were generally helping users with application-related issues, but were especially helpful to some of the young new users of APL. Some of our delegates took on another challenge in the workshop on code golfing.

I think it is safe to say that we have all thoroughly enjoyed this week. You can look forward to seeing our commercials from the Viking Challenge as well as recordings of talks from this week at some point in the future on dyalog.tv.

Dyalog ’19: Wednesday 11 September

Floaty balls

In contrast with Monday night’s brain-bending puzzles, last night there was some lighter entertainment as Richard Park presented his molecular dynamics framework APLPhys. He showed us how elegantly APL could express mathematical equations and we joined in his fascination watching simulations of little balls flying around on his MiServer based graphical interface.

APL for every kid

Roberto and students from Liceo Scientifico GB Grassi Saronno

This morning we got to hear from Roberto and his students again. Pietro, Alessandro and Gabriele told us how after they were shown APL in school their interest was sparked to the point that they would write APL in other, slightly more dull lessons. They gave us more details on their competitive league scoring algorithm which was used in Monday evening’s contest. Lastly they expressed how APL’s ability to have you think differently led them to develop their puzzle competition platform called MathMaze. They had familiarity with Python but were new to APL, so they used Py’n’APL to make Dyalog communicate with a python-based Django server. In that way, MathMaze contestants could enter either a direct puzzle solution, or an APL statement which is evaluated on the server to solve the puzzle.

Afterwards Stephen Taylor led the Young APLers panel. To begin he introduced us to Josh David from the small town of Scranton, PA. We learned how he started working with APL at 15 years old after being introduced to it by his neighbour Paul Mansour of The Carlisle Group. Next was James Heslip from Optima, telling of his discovery of programming through Visual Basic. During and after university he wanted to pursue computing but keep the maths aspect of his work in the future. After meeting Paul Grosvenor he managed to convince Paul to take him on as an apprentice at Optima, and now APL allows him to write programs using mathematical notation. Yuliia Serhiienko from Ukraine came next to the stage, and said how she loved mathamatics in school but never imagined becoming a programmer. She had been an actuary in a previous life but, in the end, her transition from Excel macros to APL turned out wonderfully. Alve Björk, last year’s competition winner, claimed to spend more time reading about programming languages than actually programming. He said that in many languages he will think of a program but not write it. However, since APL is terse he actually sometimes tries it out when he thinks of a program. Alve also stated that he found it interesting that when you have a problem, in APL it’s not the first thing you do to go online looking for a ready made solution.

The young APLer’s panel. From left: Stephen Taylor, Alve Björk, Yuliia Serhiienko, James Heslip and Josh David

All of the panelists discussed the importance of having a teacher and being able to ask questions. It was suggested that some kind of mentor system for APL could be fostered. Once again the idea of “spreading the gospel” and getting APL in front of more people was brought up, and how it may be necessary to do this in order for the community to grow – as much as some of us would like it to remain niche.

The 2019 APL Problem Solving Competition

Professional prize winner Torsten Grust

Finally, the moment we’d all been waiting for: the prize ceremony for this year’s problem solving competition. Brian Becker talked about how we had made the leap to “eat our own dog food”, having built and hosted the competition website using MiServer (you can still see it at dyalogaplcompetition.com). Many technologies came together so that Dyalog could have the Phase I “one-liner” problems automatically validated in collaboration with TiO.Run. We saw some stastics about registrations and submissions, and heard about the extremely high quality of both Phase I and Phase II entries this year.

Then Gitte presented the top professional and student competition winners with their prizes. Torsten Grust expressed how much fun he had thinking about the problems and how clever he felt when he managed to come up with his solutions.

Grand Prize winner Jamin Wu


The Grand Prize winner Jamin Wu told us about how he discovered programming when he was looking into ways to solve problems using computers – something he still needs to do despite being a medical student – and how he had found the APL family of lanugages via the project Euler website. Jamin then took us through some of his solutions, including his incredible invertible tacit functions for tap encoding and decoding. He expressed how nice it had been to think about his implementation of the Romberg method of integration by solving the problem with a pen and paper first, and then implementing the refined solution at the end, since writing the APL was so cheap in terms of effort. We were enthralled by his brilliant explanations and incredibly impressed by his well considered problem solutions.

After lunch we were made extremely busy in the Viking Challenge. The delegates were split into teams and had to make short commercials emphasising a certain aspect of APL to a particular audience. We expect to see some oscar-winning performances at the screening after the banquet dinner – so now it’s time to get on my Sunday Best ready for the prize acceptance speech I expect to make.

Dyalog ’19: Tuesday 10 September

2⍴⊂’APL’

Last night Roberto Minervini and his students Pietro Pio Palumbo, Gabriele Meroni and Alessandro Laselli of Liceo Scientifico GB Grassi Saronno conducted A Puzzle League – sneakily introducing us to another APL. The delegates were divided into teams who competed to solve 18 maths and logic puzzles, which could be solved both using APL and with good old pen and paper. The scoring system rewarded teams who solved puzzles that other teams did not solve, but it was soon clear that the real challenge was solving the puzzle whatsoever in many cases. The furious cognitive battle lasted long into the night but eventually the team “AdamsAPL” (Adám did not choose the name) beat “MKTeam” (Morten may well have chosen the name) to prove that, although Morten Kromberg is the CTO, he should be glad to rely on the problem solving capabilities of Dyalog’s employees.

Roberto and Pietro introduce another ‘APL’

Application Station

Marshall shows us a bit of Dyalog ‘under the hood’

This morning the second day of talks commenced. While the first talk of the day had Marshall Lochbaum melting brains with the details of utilising CPU vector processing (among other techniques) for implementing fast reductions, the majority of the day’s talks focused on various tools for developing software applications with Dyalog.

Richard Park and Michael Baas gave an update on recent developments of the statistical package TamStat. The creator, Stephen Mansour, couldn’t be with us this week as he is using TamStat to teach his class at the University of Scranton, PA.

Erik Wallace gave us a view of the wide range of functions available in his cryptographic library Mystika. His talk mentioned promising work in combination with Aaron Hsu’s co-dfns compiler to give speed ups, as well as some of his own work on algorithms and implementation. Erik also expounded on some non-cryptographic use cases such as high precision squaring and inverses.

Stig Nielsen of SimCorp

Stig Nielsen told us how SimCorp is moving Dimension to the cloud – an undertaking which requires that the business logic within its 2.5 million lines of APL code be moved from the desktop application to the server and run on multiple instances of Dyalog within a .NET process.

Asset and Liability Management has been getting more popular as the legal landscape changes and SimCorp Italiana have been swift to account for those needs. Francesco Garue gave an impression of the complexity of ALM and how SimCorp Italiana have been trying to tame their “pretty messy scheme” by, for example, removing the dependency on system-specific databases or tables.

Another asset management system was presented by Claus Madsen of FinE Analytics. Claus has been using Dyalog since version 6 so he has seen the evolution of APL user needs over the last thirty years. He showed us how he has been using .NET classes to allow his APL solution to integrate with other languages used by those he is working with, using an object oriented model to handle settings for various types of financial data.

Gooey GUI

Brian Becker shows us the HTMLRenderer

The HTMLRenderer has been developed to enable easy creation of cross-browser user interfaces using web technologies. Brian Becker drew some analogies between his granddaughter and HTMLRenderer over their respective developments, from sometimes making a mess (SYSERROR) to becoming more able to communicate over time (WebSockets). He then introduced some recent changes and additions to the way the HTMLRenderer is used in Dyalog 17.1. However, he also explained that MiServer sites would need no change to their code in order to run as a desktop application using the HRServer (HTMLRenderer Server).

Josh David has recently transferred from Dyalog user to Dyalog employee. Neatly segueing from Brian’s talk, he gave us a demonstration of the tools he has created which use the HTMLRenderer to quickly and easily create graphical elements in the Dyalog session.

Josh David demonstrates his Easy GUI

And now for something completely different

Somehow COO Andy Shiers of Dyalog keeps improving the fireside chat, and this year has reached version 5! Jokes aside, his fireside chats are an opportunity to address a few points which might not fit into the scope of other individual talks. This year Andy informed us about why it is now really important that the interpreter knows its serial number, and gave us his usual smorgasbord of tips on subjects such as: the new Windows “backtick” keyboard enhancement, resizing the language bar, the memory manager I-Beam (2000⌶) and using ⎕NINFO on directories where there are inaccessible subdirectories. In return he asked the we send him examples of APL errors which would be made clearer with better DMX messages.

Nathan Rogers creates Excel spreadsheets using Dyalog all the way from Colorado

Excel and APL: A match made in Windows – now available cross-platform. As new recruit Nathan Rogers demonstrated, since modern Excel spreadsheets are zipped XML documents using the OOXML specification, Excel spreadsheets can be created directly from APL arrays on any platform. Unfortantely Nathan could not be here in person due to an important performance of Argentine tango with his wife conflicting with the User Meeting. However, he was still able to present via video-link – what a time to be alive!

Don’t forget that tomorrow we will be live streaming the prize ceremony for the 2019 APL Problem Solving Competition on dyalog.tv from 11:00 until 12:00 (09:00 to 10:00 UTC).