SSL: The Rigors of Testing

SSL: The Rigors of Testing

An unfiltered look at connected parking lot lighting systems

By Ruth Taylor

SSL: The Rigors of Testing
A luminaire is installed at Virginia Tech for the outdoor phase of the Next Generation Lighting Systems program.

The Next Generation Lighting Systems (NGLS) program has launched the first phase of its outdoor lighting evaluations, installing six connected lighting systems in parking lots at Virginia Tech Transportation Institute (VTTI) and beginning an evaluation process that will continue for the next two years. A number of lighting professionals gave up their summer evenings for the sake of a higher cause: finding out not only how easy connected parking lot systems are to install and configure, but also what happens when you add occupancy sensors. We want to know, for example, whether presence detection affects installation and configuration, and whether currently available sensors work in typical retrofit conditions. And we also want to know what owners, architects and lighting designers want from such systems—and whether presence detection in the real world actually saves energy.

Installed on individual parking lots at VTTI at a pole height of 30 ft with the poles spaced 100 to 150 ft apart, the six systems replaced 58 luminaires on nearly 350,000 sq ft of space to create a “living lab” where evaluations could be conducted in a real-world setting.

The control systems included LightGRID (Current by GE), SimplySNAP (Synapse), wiSCAPE (Hubbell Control Solutions), NearSky (Cimcon Lighting), Limelight (Lutron) and DTL DSN (Acuity Brands). In terms of technology and design, the wireless control systems used a variety of technologies and approaches that featured wired (Ethernet) and wireless (cellular) gateways, remote and fixture-integrated sensor mounting, and passive infrared (PIR) and microwave radar sensors.

Based on observations, measurements and detailed notes made during installation, configuration and operation, the team drew three overall conclusions from this initial phase of the evaluation:

  1. Installation and configuration were challenging.
  2. Once installed and configured, basic wireless control systems generally functioned reasonably well.
  3. Presence detection by sensors was very disappointing.

Installation and Configuration. Overall, we were challenged by both the complexity of the systems and the level of manufacturer support needed for their installation and configuration. System installation and configuration ranged from reasonably successful to outright failure. While it should be noted that several of the systems were new and not on the market yet, all six systems had configuration issues, as well as issues with either wiring or programming the sensors. Two systems required replacement of failed hardware, and two had problems with gateway communications.

All six systems were found to be problem-free as far as scheduling was concerned. Four of the systems dimmed adequately by the time performance was formally evaluated, although only two did so at initial start-up. However, many of the systems required multiple electrical contractor callbacks, which included multiple rides in a bucket truck to reach the luminaires and get the systems working—potentially adding considerable time and expense for building owners.

Configuration of the sensors (as distinct from the central control functionality of scheduling and dimming) was a major challenge (see below). In fact, the majority of installation and configuration issues we encountered related to presence-detection hardware. The sensors and their nodes didn’t always work together, and system integration was typically problematic.

Another thing we learned was that information provided to the installation and configuration (IC) supervisor doesn’t always make it to the “boots on the ground.” Even when the information is there, much of the time it’s not carefully read—especially when it comes to seemingly familiar tasks, such as installing and wiring a luminaire. Moreover, things still end up getting installed incorrectly when instructions are read, if those instructions aren’t clear.

Troubleshooting today’s control systems is now essentially like troubleshooting a computer—a complex process. One installer voiced concern that if he encounters issues with a system, he won’t be able to go to his local electrical distributor for spare parts to fix things, which can be especially troublesome when the resulting delay involves a dark nighttime parking lot that creates safety concerns.

Wireless Control. Overall, we found that once installed and fully commissioned, the control systems worked for the most part, doing a good job of scheduling, dimming, monitoring and reporting.

Presence Detection. We were especially disappointed to find that none of the six presence-detection systems we tested performed successfully. As noted above, initial start-up was an issue with most of the systems. There were wiring issues and false triggering, and occupancy groups were either not configured or weren’t saving correctly. In some cases, sensitivity levels weren’t set correctly.

Although we found presence detection to be a major problem, it was sometimes difficult to tell from sensor performance whether this was due to an improper setting or an equipment issue. All six systems had issues with occupancy sensitivity or latency; again, it was often difficult to tell which issue was the culprit. Only one system had fully functioning occupancy sensors at start-up, and none of the systems showed reliable, consistent presence detection during the performance evaluations.

Infrared technology appears to have significant limitations in outdoor applications, and issues related to latency, sensitivity and coverage are intertwined, which creates a “perfect storm.”

WHILE ALL WORKING SYSTEMS successfully provided monitoring capabilities, the user interfaces could use improvements in order to meet users’ actual needs, especially in the case of more-advanced users who need more engineering data or detailed status indications. And it’s clear that in order to ensure that these systems continue to work properly, manufacturer support is not only necessary, it’s critical—as it is throughout installation and configuration.

Perhaps our most significant finding was the poor performance of the passive infrared sensors installed on-site. Industry has an important challenge and opportunity to bring presence detection technology up to the demands of current energy codes and environmental imperatives. Of course, this is a challenge that faces the design community as well.

The NGLS outdoor evaluations are far from over; they’ll continue, with user assessments as well as more-detailed performance analysis and more-controlled sensor studies. So stay tuned for more results.

Author’s Note:
A shout-out is in order for the manufacturers who donated equipment and braved the rigors of an NGLS evaluation in the interest of improving their products. Co-sponsored by IES, the U.S. Department of Energy and the International Association of Lighting Designers, NGLS evaluates today’s connected lighting systems in real-world installations, in order to identify challenges in installation and operation, reveal needed product improvements, and articulate principles and best practices that will reduce configuration complexity and enable system performance to meet expectations.

Contributor(s)

Ruth Taylor

Ruth Taylor

Ruth Taylor currently serves as a program manager on the Advanced Lighting Team at Pacific Northwest National Laboratory, where she manages the Next Generation Lighting Systems evaluations and contributes to several other projects focused on the application and development of... More info »

EP Zoom Platinum Sponsor - $20,000

What’s in it for you?

  •    Sponsor 5 Students/Emerging Professionals and the EP Day presentation platform
  •    Visibility and awareness before breakout rooms and throughout the event
  •    Opportunity to present a live or prerecorded personal closing message (15 seconds-1 minute duration)
  •    Shout-outs throughout the event
  •    Recognition as an EP Program Sponsor on all event communication
  •    Recognition on the IES Annual Conference homepage
  •    Recognition on the IES Annual Conference Emerging Professional homepage

EP Sponsorship Opportunities

Sponsor students and emerging professionals to attend the virtual Annual Conference event or the in-person Street & Area Lighting Conference. Student and EP recipients selected by Emerging Professional Committee.

EP Breakout Room Sponsor - $8,000

What do you get?

  •    Sponsor breakout room for live engagement and networking during EP Day
  •    Opportunity to present a live or prerecorded personal welcome message (15 seconds-1 minute duration)
  •    Visibility and awareness at the start of the schedule
  •    Personalized zoom backgrounds for moderators
  •    Recognition as an EP Program Sponsor on all event communication
  •    Recognition on the IES Annual Conference homepage
  •    Recognition on the IES Annual Conference Emerging Professional homepage
  •    Opportunity to provide personalized swag to attendees and moderators

EP Game Sponsor - $5,000

What are the benefits?

  •    Sponsor live interactive game session(s) during EP Day
  •    Ability to use your personal game hosting platform for the game session (IES can provide platform if needed)
  •    Be a Game Co-Host
  •    Opportunity to provide personalized swag or selection of IES publications as prize options

1 X Event Sponsor - $5,000

What’s in it for you?

  •    Visibility and awareness before breakout rooms and throughout the event – graphic image of logo
  •    Opportunity to submit a prerecorded personal opening/closing message (15 seconds-1 minute duration)
  •    Shout-outs throughout the event
  •    Recognition as a Leadership Forum Sponsor on all event communication
  •    Recognition on the Leadership Forum homepage

6 X Breakout Room Sponsor - $1,000 – (1 for each of 6 Breakout Rooms)

What do you get?

  •    Visibility and awareness at the start of the schedule – [verbal announcement/thank you]
  •    Personalized Zoom background for moderators – [moderators must use if provided by sponsor]
  •    Recognition as a Leadership Forum Sponsor on all event communication
  •    Recognition on the Leadership Forum homepage

3 X Leadership Forum Kahoot Game Sponsor - $500

What are the benefits?

  •    Sponsor live interactive Kahoot game session(s) during LF Day
  •    Be a Game Co-Host (optional)
  •    Recognition as a Leadership Forum Sponsor on all event communication
  •    Recognition on the Leadership Forum homepage

1x Gold Sponsor- $25,000

  •    Recognition as a Gold Sponsor in a fourth (1/4) page placement for 2 months in LD+A magazine
  •    Recognition as Gold sponsor on event app and all event communication, excluding Registration and Daily Digest communications
  •    Full registration for two (2) to the Annual Conference
  •    Company logo and hyperlink placed on exhibitor page within event app

2x Keynote Sponsor- $10,000

  •    2-3 minute Opening
  •    Introduce keynote speaker
  •    Company logo and hyperlink placed on exhibitor page within event app

5x Virtual Break Sponsor - $6,000

  •    Provided graphic visible during break duration
  •    Recognition as Virtual Break sponsor on event app and all event communications, excluding Registration and Daily Digest communications
  •    Full Registration for one (1) to the Annual Conference

1x Opening Session Sponsor- $5,000

  •    90-second video prior to session start
  •    Company logo and hyperlink placed on exhibitor page within event app

1x Closing Session Sponsor- $5,000

  •    90-second video prior to session start
  •    Company logo and hyperlink placed on exhibitor page within event app

1x Society Update Sponsor - $5,000

  •    Recognition as Society Update sponsor throughout web
  •    Recognition as Society Update sponsor on event app and all event communication, excluding Registration and Daily Digest communications
  •    Full registration for one (1) to attend the 2021 Annual Conference
  •    90-second video prior to session start

1x Registration Sponsor - $5,000

  •    Visibility as sole sponsor on the registration page and in all registration focused communications
  •    Company logo and hyperlink placed on exhibitor page within event app

1x Daily Digest Sponsor - $5,000

  •    Visibility as sole sponsor in all Daily Digest focused communications
  •    Recognition on event webpage and communications as Daily Digest Sponsor

10x Event App Exhibitor Page Sponsor - $1,000

  •    Company logo and hyperlink placed on exhibitor page within event app