Title page for ETD etd-11292010-143123


Document Type Master's Dissertation
Author Barla-Szabo, Daniel
Email danielbarla@gmail.com
URN etd-11292010-143123
Document Title A study of gradient based particle swarm optimisers
Degree MSc
Department Computer Science
Supervisor
Advisor Name Title
Prof A P Engelbrecht Committee Chair
Keywords
  • Artificial intelligence
  • gradient methods
  • hybrid
  • particle swarm optimisers
Date 2010-05-19
Availability unrestricted
Abstract

Gradient-based optimisers are a natural way to solve optimisation problems, and have long been used for their efficacy in exploiting the search space. Particle swarm optimisers (PSOs), when using reasonable algorithm parameters, are considered to have good exploration characteristics.

This thesis proposes a specific way of constructing hybrid gradient PSOs. Heterogeneous, hybrid gradient PSOs are constructed by allowing the gradient algorithm to optimise local best particles, while the PSO algorithm governs the behaviour of the rest of the swarm. This approach allows the distinct algorithms to concentrate on performing the separate tasks of exploration and exploitation. Two new PSOs, the Gradient Descent PSO, which combines the Gradient Descent and PSO algorithms, and the LeapFrog PSO, which combines the LeapFrog and PSO algorithms, are introduced. The GDPSO represents arguably the simplest hybrid gradient PSO possible, while the LeapFrog PSO incorporates the more sophisticated LFOP1(b) algorithm, exhibiting a heuristic algorithm design and dynamic time step adjustment mechanism. The strong tendency of these hybrids to prematurely converge is examined, and it is shown that by modifying algorithm parameters and delaying the introduction of gradient information, it is possible to retain strong exploration capabilities of the original PSO algorithm while also benefiting from the exploitation of the gradient algorithms.

2010, University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria.

Please cite as follows:

Barla-Szabo, D 2010, A study of gradient based particle swarm optimisers, MSc dissertation, University of Pretoria, Pretoria, viewed yymmdd < http://upetd.up.ac.za/thesis/available/etd- etd-11292010-143123/ >

C10/887/gm

Files
  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
  dissertation.pdf 5.44 Mb 00:25:11 00:12:57 00:11:19 00:05:39 00:00:29

Browse All Available ETDs by ( Author | Department )

If you have more questions or technical problems, please Contact UPeTD.