Magento 2 Modularization

Magento-modularityA major goal of Magento 2 is to make it even easier to extend and adapt to the needs of merchants wanting a true flexible platform. The service layer work I described in a previous post is a part of this. The service layer helps provide a constrained, well defined API for other modules to call. But there is more being done. While Magento has always had a modular architecture, the current module boundaries are not always ideal. Magento 2 includes significant module rework to improve some of the divisions to make it easier to extend Magento.

Disclaimer: I work with the Magento team, but this post contains personal opinions and perspectives and does not necessarily reflect those of eBay Inc.  Or in other words, this post is not binding!

Acknowledgements: This post has borrowed heavily from Anton Kril’s () presentation at the Magento Imagine 2014 conference.

Framework vs Modules

The first stage of reworking modularity in Magento 2 was to pull out from modules what should be in the underlying Magento framework. Modules are intended for e-commerce functionality. The core framework functionality should be in the framework, not mixed in with modules. As a result, many areas of framework functionality have been pulled from modules and added to the Magento framework. Core from Magento 1 was the biggest example of this – most of Core is now in the Magento Framework. Another example is the Theme module where most of the processing logic has been moved into the Framework (the Theme module still exists in this case – it contains the UI for allowing the site administrator to change which theme to use).

Divide and Conquer

Next, work started on decomposing some existing modules into multiple smaller optional modules. For example, the configurable and grouped product types are now defined in separate modules. If you don’t need grouped products, you can remove that module from your site. Fewer modules means less to maintain, less to go wrong, and a slightly more performant site (less code). Shipping is another module that has been broken up into multiple modules. A module has been defined per major shipping vendor (FedEx, UPS, USPS, etc) allowing a site to be built from the shipping mechanisms supported for the site. It also allows other shipping methods to be more easily incorporated later.

In addition to shipping and product types, other modules being considered for rework (broken up) include payments, sales, and checkout. Feel free to note your favorites in a comment!

Module Break Up

It is worth noting that refactoring code to improve modularity is not always straightforward. For example, pulling product types out into multiple modules (rather than being hard coded in a single module) caused some implementation complications. To render a shopping cart containing different product types required some rethinking. The solution taken was to introduce a new block whose purpose was to render the cart. The product types in separate modules then register how to render themselves with this new cart-rendering module.

One focus is to make it so that geographic specific functionality is easier to customize or remove. For example, USPS (US Postal Service) is now in its own module making it easier to remove for non-US sites. This is an ongoing area of development with additional work planned before the developer beta release.  More modules under consideration for simplification and rework include: Logging, Admin Notification, RSS, Log, Weee, Tax, and Search. Each is being considered based on merit, while keeping an eye on the Magento 2.0 delivery date.

The Magento team has been working hard on getting Magento 2 ready for release. Not all of the potential modularity rework will be undertaken by the Magento 2.0 dev beta release due to the sheer code volume – the team are focussing on doing the most important ones well. If you have an interest in helping decouple modules please leave a message or otherwise reach out to me. Getting small pockets of experts on specific groups of modules may be one way to get more done before the developer beta. (However, no promises!)

Measuring Progress

If you look back at an earlier post titled Visualizing Magento 2 Module Dependencies, I described the module dependency graph before the modularity rework began. The sheer number of cross dependencies looks pretty darn scary. Thinking more about it since then, it is hard to capture a data based metric that really indicates success. I mentioned a goal of reducing the number of dependencies, but to make the system more modular, some modules have been broken into smaller (easier to replace) modules. As a result, the total number of dependencies has gone up, but for positive reasons. Cycles are less desirable as you cannot remove modules in the cycle (you need all or none). However they are not unacceptable as there are ways to extend or customize functionality without removing a module. There are also specific places in Magento that people are more likely to customize. Improving such hot-spots is more important than the global metrics. I like metrics to measure progress, but I have not come up with one I like yet.

Conclusions

Progress is being made on cleaning up the internal dependency graph for Magento 2. This is currently based on subjective feedback and customer reported problem areas, rather than mathematical models such as cyclometric complexity. More importantly, there are a number of key technologies going into Magento 2 to help improve modularization. Getting these into the framework now is more important than improving all of the module dependencies as the dependencies can be tackled incrementally in future releases with relatively minor impact. Changing the underlying framework can have a much greater impact.  So what are some of these technologies?

  • Enhanced layout files supporting better inheritance and extension, making it easier for one module to add it’s UI components to another module.
  • Cleaner HTML markup separating presentation from structure, making it easier to repurpose existing HTML by adjusting the CSS without markup changes.
  • Better separation of HTML markup into template files (out of PHP code) making it easier for other modules to override such HTML.
  • The introduction of the service layer, as a part of separating presentation code from business logic and defining well defined APIs to be used for dependencies between modules.
  • Dependency injection, which makes it simpler to replace one implementation of a class with another.
  • Plugins, which allow one module to inject code into the flow of another module without going to the extreme of class rewrites (which cause conflicts when multiple modules want to extend the same class).

I plan to cover more of these topics in future posts.

8 comments

  1. How will it be distributed? Will unwanted modules have to be stripped out manually or will it be just a deactivation w/o codebase removal? Same question for upgrades.

    1. It is still being explored, but it seems useful to do both – be able to deactivate but keep code, and remove code completely. We are exploring composer (including reading up on what the community has been doing with Magento 1). I would like to be able to assemble a really minimal site, but this requires reducing the number of cross module dependencies. But final approach has not been finalized. Do you have a preference?

  2. Mathew Beane · · Reply

    I would like to see nearly completely modularization, something like the standard you see within the linux community. You could go even further with this and think of it as “distributions”. Composer is a perfect way to handle the package management within this.

    Either way, please make sure its less ambiguous that mage 1x. Require the extensions to be programmed so that adding and removing them is easy to manage and will not break the site. Additionally having an option in the admin to “disable” the modules is fine, but it really should do just that. I think there are times when modules are toggled off for a time, and its probably important to be able to disable them in addition to removing them.

    Core extensions and other extensions that would make the site break if they were toggled off and/or removed should be clearly defined. The idea of having even more modules, and more granularity within the sub-modules is great, but it will also add confusion to the end-user admin’s who historically try a lot of funny business with the menu’s provided to them.

    1. M2 will be a lot better, with a lot more plumbing in place, but php makes it hard to guarantee extension developers don’t break the rules. Also I am looking forward to feedback later from extension developers on what we got right and what needs further work. Maybe in a few months once we get the new deployment tool progressed further. I would probably leave it a little longer to let us get a bit more done first.

  3. Matthias · · Reply

    Hi Alan,

    I just wanted to drop a “thank you”. Your articles are very valuable and do a great in job explaining the rationale behind the developments in Magento 2.

    1. Thanks. I am glad they are useful. Do you find the “why” more important or the “what”? I am not trying to rewrite the manuals, which could become a risk. Always interested in feedback on what is useful and what is not.

      1. Matthias Zeis · ·

        Material on the “why” is more important to me at the moment. This is part of the work eBay has to do now to convince merchants, solutions partners and other people in the eco system why an overhaul like this is useful and necessary, why it is legitimate to invest effort in rewriting tools, extensions and such.

        As you mentioned, the “what” is what has to be in the manuals. It’s the essential part of a good documentation. Including the “why” in the documentation would make the documentation stellar. Getting the word out on what the considerations are behind the architecture of a complex system such as Magento can ease the learning curve and improve the quality on whatever the community produces. I’d hope that this also helps the acceptance of Magento 2 in the whole e-commerce area.

        People like Vinai Kopp, Alan Storm and others (sorry to everybody I didn’t mention, you know who you are!) do a very good job of making people understand how Magento works and how to solve their problems themselves. I think that’s of similar importance to a strongly community-influenced software as it is in that famous man-fishing-quote (“give a man a fish and you feed him for a day; teach a man to fish and you feed him for a lifetime”).

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: